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Brief Reports: 


A New Publication Procedure 


For a trial period, the Journal of Consult- 
ing Psychology will accept “brief reports’ for 
early publication without expense to the au- 
thor, under certain conditions. The new pro- 
cedure is intended to reduce publication lag 
and permit the circulation of worth-while 
studies of specialized interest or minor im- 
portance which cannot be accepted at present 
because of limitations of space. 

A brief report, strictly limited to one printed 
page, may be accepted if the author agrees to 
make a more extended report available. Up to 
four pages in each issue may be devoted to 
brief reports, published in the order of their 
receipt without regard to the dates of receipt 
of articles accepted for regular publication. It 
is anticipated that most of the brief reports 
can appear in the first or second issue to go to 
press tollowing their acceptance. 


The procedure for submitting a brief re- 
port is: 

1. The author sends the editor both the 
brief report and a more complete report of the 
study. The full report should be of sufficient 
length to give a clear account of the back- 
ground, procedure, results, and conclusions of 
the study. 


2. The full report is prepared in the style 
specified by the Publication Manual [1], ex- 
cept that it may be typed with single spacing. 
The editor will send the full report to the 
ADI. 


3. The brief report gives a clear, condensed 
summary of the procedure of the study, and 
as full an account cf the results as space per- 
mits. To insure that the brief report does not 


exceed one printed page, the author prepares 
it according to these specifications : 

The text of the brief report, including all 
matter except the title and the author’s lines, 
does not exceed 80 typewritten lines averaging 
42 characters and spaces in length. Set the 
typewriter margins for short lines of 42 char- 
acters, which are 3.5 inches long in elite typing, 
or 4.2 inches long in pica. The manuscript is 
double spaced throughout and, except for the 
short lines, follows the standard style [1]. 


Headings, tables, and references are avoided 
in the brief report. If essential, they must be 
counted in the 80 lines. The brief report in- 
cludes, within its 80 lines, a footnote in this 
style: 


1An extended report of this study may be ob- 
tained without charge from John Doe, 300 Market 
St., Prospect 6, Mass. [giving the author’s full name 
and address] or for a fee from the American Docu- 
mentation Institute. To obtain it from the latter 
source, order Document No. .... from ADI Auxiliary 
Publications Project, Photoduplication Service, Li- 
brary of Congress, Washington 25, D. C., remitting 
Wiicais for microfilm or $........ for photocopies. 


4. The author of a brief report prepares at 
least 100 mimeographed copies of the extended 
repert. He agrees: (a) to send copies of the 
extended report upon request as long as the 
supply lasts, and (4) not to submit the ex- 
tended report for publication to another 
printed journal of general circulation. 
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Measurement Problems in Process Research 
on Psychotherapy ”’ 


Edward S. Bordin, Richard L. Cutler, Allen T. Dittmann, 
Norman I. Harway, Harold L. Raush, and David Rigler 


University of Michigan 


Testing the adequacy of theories of psycho- 
therapy has been the task of clinical research 
for many years, but only recently have we be- 
gun to examine our methods for doing it. To 
test these theories, we must first identify those 
concepts which the theorists say are important 
and translate the concepts into dimensions or 
variables which are amenable to systematic 
analysis. Next, we must carry out the analysis 
of the variables in such a way as to tell us 
something about the relative merits of the the- 
ories from which the variables were derived in 
the first place. 

We must not lose sight of the fact, how- 
ever, that the particular translation of theo- 
retical concepts into dimensions or variables is 
not only a function of the deductions and logic 
of the experimenter, but is also a function of 
the measuring instruments chosen and the con- 
ditions under which they are applied. It is to 
this latter problem that we shall give our at- 
tention in this paper. 


The Effect of Measurement Devices 


In applying currently used measurement de- 
vices to any data, one must first be aware of 
the extent to which the device itself predeter- 
mines the form in which the data are studied. 
As Coombs [2] has pointed out, one may im- 
pose unidimensionality upon an attribute when, 


1This paper is part of an investigation supported 
by a research grant M-516 from the National In- 
stitute of Mental Health of the National In- 
stitutes of Health, Public Health Service. Principal 
Investigators are: E. S. Bordin, A. T. Dittmann, 
H. L. Raush; Coordinator for the project: N. I. 
Harway; Research Assistants: R. L. Cutler, D. 
Rigler. 


2Revision of paper read by A. T. Dittmann at a 
symposium on “Methodological Problems in Psy- 
chotherapeutic Process Research” before the Mid- 
western Psychological Association, Chicago, May, 
1953. 
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in fact, it does not exist. Such an imposition is 
possible by forcing raters to rate every stimu- 
lus along some arbitrarily defined unidimen- 
sional continuum, even though the raters may 
not agree that every stimulus belongs on that 
continuum. Such is the case with the typical 
“Q sort” situation. In fact, in “O sorting,” 
the measurement device imposes not only uni- 
dimensionality, but also the shape of the distri- 
bution and the characteristics of an interval 
scale. Rating scales, which are the most fre 
quently used measurement devices for psycho- 
therapy variables, force data into unidimen- 
sional continua. Coombs’s unfolding technique 
[1] provides a method for testing unidimen- 
sionality of such scales, but to our knowledge 
has been used only once in connection with the 
data of psychotherapy. In a doctoral disserta- 
tion complete’ at the University of Michigan, 
Osburn [3] worked with a variable defined as 
ambiguity of a therapist’s behavior in defining 
himself and the therapeutic task. This variable 
was subjected to a test of the assumption of 
unidimensionality, and support was found for 
the assumption. There are, however, many 
variables in psychotherapy research whose uni- 
dimensionality has not yet been demonstrated. 

In addition to the general question of the 
nature of the assumptions demanded by various 
measurement devices, there are several speci- 
fic issues in the application of measurement 
procedures which have implications for the 
nature of the variables being measured. In the 
remaining portion of this paper, we shall take 
up several of these issues in turn. 


Judges and Judgment Processes 


Of prime importance is the problem of how 
to communicate to a judge just what you want 
him to do. If, for example, one wishes to com- 
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pare judges of differing degrees of experience, 
as we do in one study, communication problems 
will arise. In dealing with the variable “depth 
of interpretation,’ we have found it necessary 
to subject statements that define points on a 
rating scale to an analysis of their communica- 
bility to judges. In this study third- and 
fourth-year graduate clinical students who had 
a minimum of 100 hours of experience with 
psychotherapy were compared with under- 
graduates in the first course in psychology. The 
naive judges varied more widely in their sort- 
ing of the defining statements than did the ex- 
perienced judges, using the Thurstone scaling 
technique. In a few instances the two groups 
scaled statements at different points on the 
scale, even though within each group there 
was high agreement with respect to the specific 
statements. 


In developing effective communication to 
judges one must first evolve a clear and con- 
crete definition of the variable under consider- 
ation. Next, instructions must be written in 
terminology which is maximally communica- 
tive to the judges. The final test of communi- 
cability, however, should be an empirical one. 


Method of Presentation of Stimuli 


The sheer extensivity and extreme complex- 
ity of the data of psychotherapeutic interac- 
tion force upon the research worker the de- 
cision as to what aspects of the data to present 
to the judge. Here again, one’s conception of 
the variable and the theory behind it will de- 
termine what one presents to the judge. 


Let us consider here two cases in each of 
which there is a decision as to what to present 
to the judges. The first is the issue of re- 
cordings, that is, shall we present the playback 
of the original tape or shall we present the 
typescript? If one believes that a judge can 
get everything he needs for the judgment from 
the typescript, then there is no question as to 
how to present the material to him. Some re- 
searchers, however, might think that some 
variables depend also on nonlanguage factors 
such as tone of voice, emphasis on different 
words, and the like. An example is the vari- 
able of “warmth,” in which it seems true on 
the face of it that a judge deprived of tone of 
voice would be judging something else besides 


warmth. “On the face of it,” however, is never 
the best basis for decisions, and one should test 
empirically before going on to relate judgments 
on one variable with judgments on another. 


The second case in which method of pre- 
sentation is important is the choice of unit. 
Most frequently in psychotherapy research, the 
unit chosen has been that of the single response 
by patient or therapist. Since a response unit 
is defined as a speech by one person between 
two speeches by the other person, the size of 
this unit is determined by the willingness of 
either person to react verbally to what the 
other has been saying or doing. ‘hus, smaller 
patient response units occur in the case of the 
talkative therapist than in the case of the taci- 
turn one. 


If one defines units on arbitrary bases, such 
as time intervals, the meaning of the inter- 
view may be undermined. For example, it 
seems clear—again “on the face of it’”—that 
transference comes in larger packages than 
does reflection of feeling, and that to ask 
someone to judge transference on the basis of 
a small unit would be destroying what you 
want to look at before you get a chance to look 
at it. But while the direction of choice of unit 
size seems clear in the case of this variable, the 
issue is not as simple in other cases as, for ex- 
ample, when we are investigating therapist’s 
level of participation, where momentary fluc- 
tuations are the rule rather than the exception. 
In large units these fluctuations would be 
wiped out, while in very small units the vari- 
able might not be comprehensible to the judge. 
If, on the other hand, one defines units on the 
basis of meaning, such as topic or interaction 
sequence, reliability of identifying the unit 
may be low. It is our contention that empirical 
tests of these questions should be made for 
each variable under consideration before the 
variable is used for theory testing. 


The Effect of Context 


There are two further questions allied to 
problems of method of presentation: (a) how 
much information or context a judge must 
have to make a valid and meaningful evalua- 
tion of the interview material with respect to 
the variable being rated, and (4) the relevance 
of the information or context to the judgment. 
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In practice it is frequently difficult to differ 
entiate between these two aspects of the prob- 
lem. In one unpublished study by Bordin, con- 
text as a factor in measurement was subjected 
to test in connection with a variable represent- 
ing the degree to which the therapist stays 
within the patient’s frame of reference. In this 
study ratings based on access to the total type- 
script were compared with ratings where only 
the therapist responses were available, and 
these either in correct sequence or in random 
order. We feel that the necessity for test- 
ing the efiect of context is underlined by the 
embarrassing results that the different con- 
texts for the ratings in this study were a neg- 
ligible source of variance in the agreement 
among raters. 

A number of explanations for these results 
present themselves. One is that the judges’ 
ratings in the study just mentioned were in- 
dependent of the patients’ behavior or verbal- 
izations. It may have been that the judges 
based their ratings on stylized phrases used by 
the therapist, such as “you feel,”’ or on other 
nonrelevant cues. Further research must be 
done on the effects of amount and relevance 
of information given to judges before ascribing 
the results to any one explanation. The im- 
plications of this discussion to the problem of 
validity of rating scales are rather obvious. 


Training and Attitudes of Raters 


As different theories of psychotherapy stress 
different aspects of training for therapists, so 
might they stress different aspects of training 
for raters of therapy variables. 


One namely the psychoanalytic, 
stresses freedom from personal conflict in train- 
ing for therapists. Presumably, this theory 
would also state that those raters who are 
the most free of personal conflict would be 
the most sensitive to emotionally toned as- 
pects and significances of therapeutic inter- 
actions. Requiring all raters to be free of 
conflict would cut down on the amount of 
research completed, but requiring training 
or experience in psychotherapy leads to prob- 
lems which are just as hard to deal with. 
On the one hand, it is necessary that judges 
have acquired the observational attitudes 
which will make for sensitivity to the phe- 


theory, 


nomena they are asked to judge. In some 
cases, not to specify prerequisite training may 
be equivalent to asking an observer to describe 
a microscopic organism without benefit ot a 
microscope. On the other hand, we want to be 
sure that training contributes only sensitivity 
to phenomena and not sensitivity to 
phrases as the study on context above implied 

if two experts agree, we want to be sure they 
are not simply involved in a theoretical folie 
a deux. No matter how self-evident the issue 


catch 


of training may be, here again we have some- 
thing which can and should be subjected to 
empirical test. 


Engineering and Transcription Problems 
I 


In addition to the measurement problems we 
have been discussing, attention should be called 
to the problems associated with clear recordings 
and consequently the reliability of transcrip- 
tions. On the surface, these seem to be of little 
importance, since this aspect of engineering is 
much simpler than human interaction. Conse 
quently, a belief bas developed that electrical 
recording guarantees objectivity in research on 
interview material. Unfortunately, we have 
not always found this guarantee to hold. In 
formal studies of intertypist 
transcribing interviews indicate that objectiv- 
ity is highly dependent on the quality of the 
original tapes. Even good tapes are to some 
extent projective techniques for typists, raising 
problems which may be interesting in them 
selves, but not helpful to research in psycho- 
therapy. In some cases we found complete re- 
versals of meaning in therapist or patient 
statements from one typist to another. Hence, 
selectivity must be exercised in choosing those 
recordings which will be used as data. Another 
method of insuring greater objectivity in trans- 
criptions includes the development of standard 
instructions to typists for indicating pauses, 
voice inflection, laughter, weeping, and the se- 
quence and numbering of responses. 


agreement in 


Conclusions 
To summarize, we have, in this paper, re- 
viewed some problems in measurement of ther- 
apy variables. Some of the problems involve bas- 
ic issues associated with questions of the di- 
mensionality of these variables; other problems 
which must be dealt with concern communi- 
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cation to judges, the method of presenting 
stimuli to judges, the effects of context, and 
the training and experience of judges. 


These problems of measurement and the 
conditions under which it is applied may or 
may not have direct relationship with any 
given theory of psychotherapy. A theory may 
dictate the conditions under which a specific 
variable may be measured; a theory may mere- 
ly indicate that different conditions of measure- 
ment for the variable should or should not 
lead to differing results; or a theory may not 
lead to any specific deductions with regard to 
the effect or lack of effect of different meas- 
urement conditions. Where the theory gives 
some indication with regard to measurement 
conditions, as in the first two instances cited, 
the empirical tests suggested in this paper may 
serve two functions: (a) as a check on the 
validity of the instrument such as was indicated 
in discussing the effect of context, and (4) as 
an initial check on the theory where the valid- 
ity of the instrument can be determined by 
other criteria. Where theory does not lead to 
specific deductions with regard to the effect or 


lack of effect of different measurement con- 
ditions, the empirical tests suggested can indi- 
cate the extent to which our findings are bi- 
ased by the experimental situation. 


We have emphasized that the meaningful- 
ness of research on psychotherapeutic interac- 
tion depends heavily on the degree to which 
the measurement issues involved in such re- 
search have been dealt with. Many of the re- 
sults of current research on psychotherapy are 
open to question because of an apparent fail- 
ure to recognize this fundamental point. 


Received July 29, 1953. 
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A Method for the Empirical Study of 
Psychodiagnosis ** 


Albert Kostlan’ 


VA Hospital, Oakland, California 


The scientific study of psychodiagnosis re- 
quires that the clinician-subject should operate 
in a context which resembles the actual condi- 
tions of his service function. To accomplish 
this with any degree of rigor without first re- 
ducing the process to useless oversimplicity 
raises many problems. While making a diag- 
nostic study the clinician typically uses first- 
hand observations, a battery of tests, and usu- 
ally some kind of case history material, in 
combination. The clinician manipulates cues 
obtained from various sources and arrives at 
inferences for the purpose of making clinical 
predictions, descriptions (i.e., diagnosis), or 
making decisions about a person. He may make 
accurate inferences, but often cannot com- 
municate to others the process underlying the 
inferential product. He may be unaware of 
the existence, value, or source of the cues he 
uses. 


This complex process must be studied by 
isolating meaningful problems. One aid in do- 
ing so is to conceptualize psychodiagnosis as an 
inferential process regardless of how subjective 
or intuitive it may appear to be [4]. Relation- 
ships may be determined and measured be- 
tween the cues presented on the one hand and 
the verbalized inferences on the other—with 


1From the Veterans Administration Hospital, San 
Francisco, California. The statements and conclu- 
sions published by the author are the result of his 
own study and do not necessarily reflect the opinion 
or policy of the Veterans Administration. 


2This article is based upon a dissertation sub- 
mitted by the writer in partial fulfillment of the re- 
quirements for the Ph. D. degree, University of Cal- 
ifornia (Berkeley), 1952. 


8The author wishes to thank Dr. Theodore R. 
Sarbin, Department of Psychology, University of 
California, Berkeley, and Dr. Robert E. Harris of 
the Langley Porter Clinic, San Francisco, Califor- 
nia, for their critical reading of this paper. 
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the clinician, with whatever processes he uses, 
considered as an intervening variable. 

With this point of view, one aspect can be 
isolated for empirical study, the sources of 
cues. It may be approached by modifying re- 
search designs in other fields of psychological 
study. The “fractional omission” design intro 
duced by Brunswik [1] as a model for research 
in perceptual constancy lends itself to the 
study of sources of cues in an inferential con- 
text. The present experiment demonstrates the 
application of the fractional omission method 
to the following problem: Which of several 
sources of cues permits the clinician to make 
the most valid inferences when he uses them in 
certain combinations? The larger study [3] 
of which this is a part tested several specific 
hypotheses; but for the purpose of illustrating 
the method, only the stated problem will be 
considered. 


Procedure 


Four sources of information, typical of a 
battery a clinician might use, were systemat- 
ically eliminated one at a time, allowing the 
others to operate in a representative manner. 
The clinical judgments made from the al- 
tered batteries were measured and compared. 
It was necessary to use a small number of tests 
so that the absence of one would have a reason- 
able chance to produce a measurable difference. 
In attempting to duplicate, as far as practic- 
able, the actual clinical situation, three tests 
and a social case history were chosen as the 
sources of information to be studied: a pro- 
jective tes:, the Rorschach examination ; an ob- 
jective personality test, the Minnesota Multi- 
phasic Personality Inventory (MMPI); a 
“semistructured” projective test, the Stein 
Sentence Completion Test [6]; and a Stand- 








84 Albert Kostlan 


ard Social Case History. The last named is 
routinely gathered from every patient at the 
Oakland (California) Veterans Administra- 
tion Mental Hygiene Clinic where the test 
data were obtained. The Social Case Histories 
comprised reports of intake interviews by so- 
cial workers, and briefly covered such informa- 
tion as identifying data, family background, 
work history, military history, present social 
status, and presenting complaints. ‘I hey were 
edited only to delete directly identifying in- 
formation. The five histories varied in length 
from one-half to two pages of single-spaced 
typewritten script. The social workers who re- 
ported the interviews were not aware that 
their reports were to be used in any research 
study. These reports were used for sources of 
social data because they are typical in every 
sense, and thus are representative of the kinds 
of data available to the psychodiagnosticians at 
the clinic, and because it can be assumed that 
they reflect no systematic bias as far as this 
experiment is concerned. The tests and his- 
tories were obtained from five male outpatients, 
each of whom was in individual psychotherapy. 


The problem of establishing suitably valid 
criteria was approached in two ways. One was 
to establish “internal” validity, or the con- 
sensus of opinion of expert judges who had all 
four sources of information on the patients. 
The other validity criterion was an “external” 
one, the progress reports written by the pa- 
tients’ therapists. In order to establish the in- 
ternal criterion, the test results and case his- 
tories were reproduced on standard forms and 
presented to eight criterion judges. The selec- 
tion of criterion judges was based upon the fol- 
lowing qualifications: (a) a Ph.D. in clinical 
psychology, (4) a minimum of three years’ 
experience in psychodiagnosis, (c) familiarity 
with the tests used and with psychiatric pa- 
tients who were World War II veterans. The 
criterion judges were asked to study all the 
information available to them and then make 
“true-false” judgments on an empirically de- 
rived check list verbalized in psychologists’ lan- 
guage. 

This check list was compiled as follows: 
Sentences were copied from various psycho- 
logical reports and reduced to grammatically 
simple sentences. Half of them were rewritten 


in the logical or psychological opposite so there 
would be roughly an even number of possible 
“true” and ‘false’ answers regardless of how 
ill the patient might be. Without this precau- 
tion, the more ill a patient is, the greater 
would be the number of “true” answers since 
psychologists’ reports usually contain a pre- 
dominance of statements of pathology. A popu- 
lation of 1,000 such statements was thus 
gathered. From this, a sample of 400 items 
was obtained by means of a table of random 
numbers. Duplicate or near-duplicate items 
were removed, resulting in the final check list 
of 283 items. The choices of the criterion 
judges were item-analyzed for each patient. 
Any item upon which at least six judges (75 
per cent) agreed was accepted as being “in- 
ternally valid.’’ Between 55 and 60 per cent of 
the items survived this consensual criterion. 


A second group of statements was compiled 
from the progress notes kept by the patients’ 
therapists. These items were termed “‘external- 
ly” validated. Only behavior that could be ob- 
served directly by the therapist or that was re- 
ported by the patient was considered. ‘This pre- 
caution was taken to minimize confounding 
the therapist with the patient—which would 
have been the case if the therapists were al- 
lowed to make inferences about the patients. 
Thus, for each patient two independent sets of 
items were prepared. These were combined in- 
to a single check list for presentation to the 
subjects, but were later analyzed separately. 


In addition to the systematic elimination of 
the four sources of information, a fifth experi- 
mental condition was devised. ‘There was an 
expectation that clinicians can make inferences 
which are more accurate than chance simply by 
knowing that a person is a psychiatric patient. 
For this reason, in one of the experimental con- 
ditions the subjects were furnished with only 
the kind of information that would be avail- 
able on a face sheet. This consisted of age, 
marital status, occupation, education, and 
source of referral to the clinic. The subjects 
were told that all the patients were white, 
male, veterans of World War II, and patients 
at the clinic. Thus there were five experimental 
conditions .presented to each subject: 


I. The MMPI, Sentence Completion Test, Social 
Case History; but minus the Rorschach. 
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II. The Rorschach, Sentence Completion Test, So- 
cial Case History; but minus the MMPI. 
III. The Rorschach, MMPI, Social Case History; 
but minus the Sentence Completion Test. 
IV. The Rorschach, MMPI, Sentence Completion 

Test; but minis the Social Case History. 


V. Minimal (face-sheet) data only. 


Twenty clinical psychologists, each of whom 
had had at least two years of psychodiagnostic 
experience, and who were familiar with vet- 
eran-patients and with the tests used in this 
study, were the subjects of the experiment, 
hereinafter referred to as judges. They were 
divided into four groups of five each. Every 


experimental condition for every patient 
could not be given to every judge since 
the judges would remember characteristics 


of a given patient from one experimental 
condition to the next and thus be contamin- 
ated. It was necessary to restrict the pa- 
tient-condition combinations so that each judge 
had every patient and every experimental con- 
dition, but neither a patient nor a condition 
was repeated for any judge. The design was 
accomplished by making a five X five table, 
assigning experimental conditions to the col- 
umns, judges to the rows, and patients to the 
cells by restricted randomization from a table 
of random numbers. It can be seen that such 
an arrangement fulfills the conditions of a latin 
square [2]. Four such random squares were 
separately drawn so that in a sense there were 
four replications of the experiment—each with 
five different judges. The data were combined 
for the final statistical analysis. 

‘The judges were instructed to study the in- 
formation available, just as they would in a 
typical diagnostic study. They were then told 
to answer the items on each patient’s check 
list. The judges were permitted to refer to the 
materials as often as they wished. For the con- 
dition of minimal data they were told to read 
what was available and then fill out the check 
list in the regular vay, and to try to get as 
many “hits” as possible. 

Since the patients were identified to the 
judges only by numbers (one through five), it 
is likely that the judges would have begun 
their evaluations with patient 1 and gone 
through to patient 5. This may have resulted 
in a systematic bias since inferences made on 


the patients evaluated first could influence the 
judgments made on the last few patients. To 
avoid such bias due to order of presentation, 
the judges were required to follow a specified 
order which was randomized for each judge. 

The check lists returned by the judges were 
scored for number of disagreements with the 
“internally valid” or “externally valid’ state- 
ments. These were considered to be errors. Er- 
rors were transformed into percentages of er- 
rors since there were slight variations of pos- 
sible correct answers for each patient. ‘To al- 
low the assumption of homogeneity of variance 
to be made, the percentages were then trans- 
formed into angles equal to the arc sine of the 
square root of the percentage [5]. The results 
presented in Tables 2, 3, and 4 are 
of these angles, which closely approximate per- 
centage errors. The “ 


in terms 
nternally” validated and 
“externally” validated items were scored and 
analyzed separately. 


Results 

The subjects were able to make inferences 
which were more accurate (as defined by this 
experiment) than chance expectancy under 
each of the five experimental conditions. ‘Table 
1 presents the results of chi-square tests on the 
“internal” and “external” items for condition 
V, minimal data, the condition under which 
the 


Chance expectancy was taken as 50 per cent. 


greatest number of errors were made. 








lable 1 
Chi-Square Tests between Proportion of Er: 
Made under Condition V (Minimal Data 
and Chance 
Frequencies [ncorre Corre hi square 








Internal items 





Expected 50 50 


Observed 23 77 15.726** 





External items 


50 50 
32 68 





Expected 


Observed 6.696* 





* p equals .01. 
** p equals .001. 


The chi square for both sets of items is signifi- 
cant beyond a f of .01. 

The variance was analyzed for the four rep- 
lications combined for each of the two sets of 
items. The experimental design allows applica- 
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tion of the latin-square analysis of variance. 
These data are summarized in Table 2. Vari- 
ance contributed by patients, conditions, and 
by judges is significant. 


Table 2 
Summary of Analysis of Variance of 


the Pooled Data 


Internal items External items 


Source dj Mean Mean 
square F square F 

Conditions 

(columns ) 4 66.86 43.56" 143.52 7.01°** 
Patients 

(cells) 4 134.89 7.18°°* 112.72 5.50°°* 
Subjects 

(rows) 19 49.19 2.62°° 60.52 2.96** 


Squares X 
patients 12 
Residual 
(error) 60 
Total 99 


. 


21.09 30.10 1.47 


3.73 — 248 = 





p equals .06. 
** p equals .01. 
*** p equals .001. 


The means derived from the experimental 
conditions for the two sets of items are pre- 
sented in Table 3. According to the size of the 


Table 3 
Mean Arc Sine Percentage Errors for the 
Experimental Conditions 











In- Ex- 





Conditions ternal ternal 
items items 
I Battery minus the Rorschach 25.50 31.65 
li Battery minus the MMP}. 28.15 34.40 
III Battery minus the Sentence 
Completion Test 27.45 31.65 
IV Battery minus the Social 
History 29.65 36.30 
V Minimal data only 30.05 


37.35 





means yielded, the experimental conditions 
follow about the same order for the two sets 
of items. More “errors’”’ were made on the 
“external” items. Significance of the differences 
between these means was tested by means of ¢ 
tests, using the standard error of the mean 
differences (to account for correlational term). 
Twenty such tests were possible and were 


made. These are presented in Table 4. ‘There 
is a similarity of results obtained on the two 
independent sets of items which adds confidence 
to the interpretation that they represent actual 
differences. 


Table 4 


Summary of the ¢ Tests for the Differences between 


Means of the Experimental Conditions 
External items 


Compared Internal items 


conditions Mean diff. t Mean diff t 
I-II 2.65 1.78 —2.75 1.66 
I-III 1.9 1.30 0.00 0.00 
I-IV +1 2.03 4.65 4.69°* 
Il-V } 3.05 5.70 3.37°* 
II-III 0.54 2.75 1.36 
II-IV ) 0.80 1.90 1.12 
II-V 1.46 -2.95 1.86 

IlI-IV 2.20 1.12 —4.65 2.77* 
IiI-V 2.60 2.17* ».70 2.82° 
IV-V 0.40 0.24 —1.05 0.76 
Note.-Experimental conditions are: I battery minus 


Rorschach; Il battery minus MMPI; 
Sentence Completion; IV battery minus Social 
V “minimal” information only. 

+ 


Ill battery minus 
History ; 


p equals .05 
** 


p equals .01. 


On the “internal’’ items, i.e., those psych 
ological statements which were validated by 
consensus of the criterion judges, the only bat- 
teries which differed significantly from the 
performance made on the basis of minimal 
data (condition V) are those minus the Ror- 
schach (1) and those minus the Sentence Com- 
pletion Test (II1). One thing these condi- 
tions (1 and III) have in common is the 
presence of both the MMPI and the Social 
Case History. That is, fewer errors were made 
by batteries which contained both the Social 
Case History and the MMPI. On the “ex- 
ternal” items, i.e., those statements taken from 
the therapists’ progress notes, these same dif- 
ferences appeared, plus two others: The bat- 
teries which contained the MMPI and the 
Social Case History (I and III) also resulted 
in fewer errors than the batteries that con- 
tained all the tests, but which were with- 
out Social Case Histories (IV). 

Several conclusions can be made on the basis 
of these results: 


a. ““Minimal” data allow inferences to be 
made which are more accurate than those ex- 
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pected on the basis of chance alone. Hence, it 
follows that all the batteries allow inferences 
to be made more accurately than on the basis 
of chance alone, because the most errors were 
made under the condition of 


minimal” data. 

b. On the basis of three tests, but without 
the Social Case History, clinicians can make 
no more accurate inferences than they can 
make on the basis of only “minimal” informa- 
tion. 

c. The most efficacious batteries are those 
which included both the MMPI and the So- 
cial Case History. 

d. Patients differ with respect to the accur- 
acy with which they can be diagnosed. 

e. Clinicians differ with regard to diagnostic 
skills. 

It is not possible to draw conclusions as to 
which is the best single source of information, 
for this was not tested by the experiment. The 
answer must be found by future experimenta- 
tion. 


Discussion 


The procedure of the present experiment is 
representative of the clinical situation in the 
following important ways: It permits use of 
several sources of information in combination. 
nterpreted “blindly,” but with 
a background of 


‘Tests are not 
a social case history except 
where its elimination is a condition of the ex- 
periment. It allows the clinician to use what- 
ever approach he chooses, to be as subjective 
and intuitive as he wishes, in arriving at his 
formulations. Finally, the inferences are verb- 
alized in language typical of that used by clin- 
ical psychologists in their diagnostic reports, 
except those taken from the therapists’ notes. 
These latter, however, may also be said to be 
verbalized in psychological language. 

The chief difference between the conditions 
of this experiment and a normal clinical situa- 
tion is that the clinicians were required to make 
a dichotomous (true-false) choice on a series of 
inferences which had been taken out of con- 
text. In the clinical situation the clinician in- 
tegrates his inferences in the matrix of a psy- 
chological report where one statement logically 
precedes another until they form a cohesive 
description of the patient. Taking statements 
out of context may have had a vitiating effect 


upon the judgments. Other conditions dif 
fered, too. The judges were all busy, unpaid 
volunteers, and it is not inconceivable that they 
placed more emphasis on the MMPI and 
Social History, which take comparatively little 
time to interpret, than they did on the Ror 
schach which presumably requires hours of 
careful study. These differences between the 
experimental procedures and the clinical situa 
tion must be kept in mind when considering 
the conclusions drawn from this study. 


4 


There seems to be a superiority ot the So 
cial Case History both as a source of cues and 
especially as the background against which the 
tests were interpreted. ‘Ihis should net be sur 
prising. ‘he case history method has behind it 
a long tradition of purposefully gathering in 
formation which is pertinent to diagnosis. So 
cial workers are especially trained to provide 
this valuable adjunct to the clinicians’ skills. 
“Blind” diagnosis made from test results with- 
out regard for the patients’ background seems 
to be ineffective. The results of this study also 
suggest that perhaps it might be profitable tor 
clinical psychologists to withdraw some of the 


energy and interest now invested in the study 


of projective techniques and study ways and 
means by which the Social Case History may 
be made into an even better instrument than it 


now seems to be. 


A method was described which permitt i 


eral 


information used 


comparison of the relative validity of se’ 


sources of psychodiagnost 


in combination, und onditions somewhat 


representative of the actual clinical situation. 
An experiment was reported to illustrate the 
application of this “fractional omission” meth- 
od using a Social Case History, an MMPI, a 
Stein Sentence Completion Test, and a Ror- 
schach examination, which were gathered from 
five Veterans Administration Mental Hygiene 
Clinic outpatients. These were presented to 
eight expert criterion judges who made true- 
false judgments on an empirically derived list 
of psychological inferences. Items upon which 
at least six criterion judges agreed were con- 
sidered to be “internally” validated. Other 
items, taken from the patients’ therapy prog- 
ress notes, were considered to be “externally” 
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validated. ‘he two sets of items were com- 
bined for presentation to the subjects, but were 
later analyzed separately. 

‘The judges (subjects) were twenty clinical 
psychologists, each of whom was randomly de- 
prived of a different source of information for 
each of four patients, and given only “mini- 
mal’’ data for a fifth patient (i.e., age, occupa- 
tion, education, marital status, and source of 
referral to the clinic). Judges answered the 
items on the basis of the information available 
to them. The experimental conditions were: 
(1) Rorschach missing, (11) MMPI missing, 
(IIL) Sentence Completion ‘Test missing, 
(IV) Social Case History missing, and (V) 
“minimal data’ only. Errors were compared 
between experimental conditions by latin- 
square analysis of variance of the pooled data, 
and by ¢ tests. 

Results were highly similar for both sets of 
items, and permitted the following conclusions: 
(a) “Minimal data” permitted inferences 
which were better than chance. (6) Without 
Social Case Histories, inferences were no more 
accurate than on the basis of “‘minimal data.” 
(c) The superior batteries were those which 


included both the MMPI and the Social Case 
History. (d) Patients differ with regard to 
the accuracy with which they can be diagnosed. 
(e) Clinicians differ with regard to diagnostic 
skills. 


Received July 7, 1953. 
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The Discriminative Power of Szondi’s Syndromes 


Martin Fleishman 
Napa State Hospital, Napa, California 


While a number of studies have presented 
valuable evidence which may be employed in 
the appraisal of the validity of the Szondi test, 
little work has been done on the extent to 
which the test actually discriminates between 
different kinds of psychopathological person- 
alities. ‘The purpose of the present study was 
to discover such discriminative capabilities by 
investigating (a) the extent to which statis- 
tically significant differences appeared with re- 
spect to factorial patterns of directional reac- 
tions (called syndromes) that are allegedly 
typical of the profiles of subjects in particular 
diagnostic categories, and (4) the extent to 
which statistically significant differences ap- 
peared with respect to the sums of directional 
elements of syndromes (called signs or sub- 
signs). 


Method 


In order to determine the extent to which 
the Szondi test distinguishes (a) between nor- 
mal individuals and psychopathological indi- 
viduals, and (4) among different kinds of psy- 
chopathological personalities, the test was ad- 
ministered to a normal group and to six dif- 
ferent types of psychopathological groups. 
Along with each administration of the Szondi 
test, a pseudo-Szondi or control test was given. 

The control test. The control test, just as 
the Szondi test, consisted of 48 photographs 
and was administered in six sets. The instruc- 
tions were identical. However, the photographs 
employed in the control test were of individuals 
who were normal, or at least whose clinical 
normality was highly probable since each of 
them was selected by certain criteria. 

Each of the photographed individuals was 
selected on the basis of : 


1. A demonstration of the capacity for objective 
thinking. 

2. Sufficient indication of reasonably effective in- 
terpersonal relationships. 


89 


In addition to the criteria pertaining to the 
personal qualifications of the individual pho- 
tographed, there were other criteria of selection 
relating more directly to technical aspects of 
the photographs rather than to the kind of 
person pictorialized. ‘hese were: 


1. Size—the photograph selected and physiognomy 
portrayed should be roughly similar in size to those 
on the Szondi test. 

2. Expressive passivity—the individuals photo- 
graphed should be expressively noncommittal rather 
than actively laughing, crying, fearful, or astonished. 

3. Sartorial equality—sartorial peculiarities that 
might tend to encourage identification or rejection 
should be minimized. Hence, all of the selected indi- 
viduals wore ties, white shirts, and jackets. Uni- 
forms of any kind were excluded. 

4. Equality of background effect—background 
characteristics that might tend to encourage identi- 
fication or rejection should be minimized. Hence, no 
books, crosses, cigarettes, or flags were allowed. 

5. Facial idiosyncrasies—facial idiosyncrasies that 
might tend to encourage identification or rejection 
should be minimized. Hence, the individuals se- 
lected did not have beards, gross asymmetries, or 
scars. 

6. Race—all of the individuals pictured should be 
Caucasian, since this is apparently true for Szondi’s 
test. 

7. Sex—sexual characteristics that might tend to 
encourage identification or rejection should be equal- 
ized. Hence, all the selected individuals were men. 


These criteria pertaining to the technical 
adequacy of selected photographs were formu- 
lated in order to minimize the probability of 
responsiveness to any aspect of the picture 
other than the physiognomy represented. ‘The 
criteria pertaining to the personalities of the 
photographed individuals were designed in or- 
der to maximize the probability of clinical 
normality. Thus, for the most part, the men 
represented were individuals who have dis- 
tinguished themselves in a discipline (such as 
medicine, law, mathematics, or the physical, 
social, and biological sciences), and who have 
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held or are holding positions of administrative 
responsibility. ‘hey are individuals who are 
prominent, yet not eminent enough to be rec- 
ognized by the general public. All subjects 
were questioned afterwards regarding recog- 
nition. Although many respondents “recog- 
nized”’ “movie stars,” “murderers,” “dead 
people,” “foreigners,” in only one instance was 
it necessary to discard a record because of con- 
tamination attributable to genuine recognition. 

Although clinical normality here exists as a 
probability rather than a certitude, it should 
be recognized that it is by no means necessary 
from the standpoint of test construction that 
each, or in fact any, of these individuals be 
the personification of clinical normality, what- 
ever that may be. All that is necessary is that 
the homosexuals, if there be any, do not pre- 
ponderate in the pseudohomosexual category ; 
that manics, if such there be, do not exist 
disproportionately in the pseudomanic cate- 
gory, and so on for the other pseudocategories. 


Construction of pseudocategories. he pseu- 
docategories were constructed through the 
random assignment of the control photographs 
to sets and categories, these categories being 
identical to the eight diagnostic categories on 
the Szondi test. Thus, on the control test there 
existed the categories: homosexual (h), sadist 
(s), epileptic (e), hysteric (hy), catatonic 
schizophrenic (4), paranoid schizophrenic (p), 
manic (m), and depressive (d). However, on 
the control test these were purely nominal 
designations and did not describe the personal- 
ities of the individuals who comprised them. 
Each category on the control test had position- 
al identity in administration with its corre- 
sponding category on the Szondi test. Hence, 
the first card in the first row of the first set 
was in the & category on both tests, the second 
card was in the s category on both tests, and so 
on. The purpose of administering a control 
test was principally to determine the extent to 
which syndromes can occur in a test, the scor- 
ing categories of which have been arranged 
through the random assignment of photo- 
graphs. 

Sequence of administrations. Since the two 
tests were administered at one sitting, the ques- 
tion arose as to whether performance on the 
second test was influenced by the test preceding 


it. Ihe question pertains most directly to the 
element of fatigue. In order to minimize the 
efiect of potential contaminatory factors, the 
sequences of test administration were alter- 
nated so that one-fourth of all the subjects re- 
ceived the genuine Szondi test first at both ex- 
perimental sessions, one-fourth received the 
control test first at both sessions, one-fourth 
received the Szondi test first on the first ses- 
sion and the control test first on the second 
session, and, finally, the remainder received 
the control test first on the first session and the 
Szondi test first on the second session. 


Classification of subjects. In all, 104 sub- 
jects were tested, 32 of them presumably nor- 
mal, the remaining 72, patients at Norwalk 
State Hospital or Camarillo State Hospital. 
The psychopathological group was comprised 
of six subgroups, each of which had physiog- 
nemic representation on the Szondi test and 
an allegedly characteristic syndrome. ‘These sub- 
groups 12 nonpsychotic homo- 
sexuals, 12 psychotic epileptics, 12 paranoid 
schizophrenics, 12 catatonic schizophrenics, 12 
manic-depressive depressives, and 12 manics. 
Each subgroup included six males and six fe- 
males with the exception of the homosexuals, 
who were entirely male, and the depressives, 
who consisted of five males and seven females. 
Of the normal group, 17 were male and 15 
were female. ‘The normal group (and by “nor- 
mal” is meant no more than being able to 
function adequately outside of a mental hos- 
pital) was constituted entirely of students, 
most of them college seniors. Their mean age 
was 24.3 years, as compared with the mean age 
of 35.4 years for the psychopathological group. 
The mean interval between the two adminis- 
trations was 2.8 days for the normal group 
and 2.6 days for the psychopathological group. 


consisted of 


Criticism of method. Some procedural criti- 
cisms may be anticipated. As it is ordinarily 
employed, the clinical use of the Szondi test 
requires six to ten administrations to each sub- 
ject. In answer to the anticipated criticism 
that this study loses something by virtue of the 
fact that it was not so administered, it may be 
noted that Szondi’s tenfold procedure is more 
pertinent to the analysis of individuals than 
it is to the analysis of tests. In view of this 
fact, divergence from the orthodox procedure 
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may be permitted. In the process of being 
tested, the test was given many more times 
than the ten administrations that would have 
allowed a Szondi psychodiagnostician sufficient 
evidence for clinical evaluation. Since the test 
has been given to 72 psychopathological sub- 
jects and 32 normal subjects, twice to each 
subject, it has been adminisiered 208 times, 
and as a consequence is presumed to have been 
allowed sufficient opportunity to demonstrate 
its effectiveness. In addition, when working 
with groups, it is difficult to see why a third 
administration to each subject should be any 
better than the first or the second, or why the 
fourth should be so, or the fifth, and so on. 
Certainly, Szondi does not claim that these 
later administrations are more meaningful or 
valid. 

Conceivably, when working with a given 
individual, it is possible that a profile obtained 
from a test late in the series 
might have some special meaning—this because 
of some idiosyncratic cyclical occurrence that 
influenced this particular 
stage in the testing procedure. But the point is 
that such cyclical occurrences are idiosyncratic, 
and hence are safely cancelled out when merged 
with group trends. Thus it may be assumed 
that because of the fact of nonsynchronization 


administered 


responsiveness at 


of idiosyncratic cycles, the second administra- 
tion is as good as the sixth since there will be 
as many individuals who will be as especially 
responsive to the second administration as there 
are to the sixth. 

Nor can it be legitimately maintained that 
the assumption of nonsynchronization is un- 


justified because such psychological variables 
as boredom, practice effects, memory efiects, 
etc. do indeed exert a synchronous influence 
that 
the performance of a group is significantly dit- 


on later administrations in such a way 


ferent from its previous performance on an 
early administration. According to 5Szondi’s 
rationale, directional changes occur as a con- 
sequence ot changes in tensions in need-systems 
that are associated with particular test cate- 
‘I he 


aforementioned psychological variables are not 


gories. Such changes are idiosyncratic. 


formally considered as determinants of subse- 
quent responsiveness. I herefore, to the extent 
that such variables as boredom, practice effects, 
and memory effects do actually contaminate 
later performance, Szondi test rationale is in 
adequate in so far as it does not take this into 
account. On the other hand, if such variables 
are not considered as influential determinants 
of performance, this study cannot be criticized 
for disregarding their possibly synchronous ef 


fect in later group performance. 


Results 


The statistical analysis consists of compar- 
isons between groups with regard to (a) syn 
dromes that are allegedly characteristic of par 
ticular clinical groupings, and (6) the dire 
tional elements of syndromes. 


Table 1 describes the frequency with which 
reputedly pathological syndromes appear in the 
first administration in each of the psychopath- 
ological groups and the normal group. Data 
from the control test, as well as the Szondi 


Table 1 


Pathological Syndromes in the First Administrations of the Szondi Test and the 
Control Test 








Szondi test 


Control test 




















Psychopathological Normal Psychopathological Normal 
Syndromes subjects subjects subjects subjects 
h e bk p d m h é k p d m 

Melancholic 0 0 0 0 0 0 0 0 0 0 0 0 0 0 
Manic 1 0 0 0 0 0 0 0 0 1 0 0 1 1 
F.B. psychotic 0 0 0 0 0 0 0 0 0 0 0 0 0 0 
Schizophrenic 0 0 0 0 0 0 0 0 0 0 0 0 0 0 
Postparoxysmal 0 0 0 0 0 0 0 0 0 0 0 0 0 0 
Interparoxysmal 0 0 0 0 0 0 0 0 0 0 0 0 0 0 
Homosexual 9 0 0 0 0 0 0 0 0 0 0 0 0 0 
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Table 2 


Pathological Syndromes in the Second Administrations of the Szondi Test and the 
Control Test 














Szondi test 


Control test 











Psychopathological Normal Psychopathological Normal 
Syndromes subjects subjects subjects subjects 
h e k p d m h é kh p d m 

Melancholic 0 1 0 0 0 0 0 0 0 2 0 0 0 0 
Manic 1 0 0 0 2 1 0 1 0 0 0 2 0 2 
F.B. psychotic 0 0 0 0 0 0 0 0 0 0 0 0 0 0 
Schizophrenic 0 0 0 0 0 0 0 0 0 0 0 0 0 1 
Postparoxysmal 0 0 1 0 0 0 0 0 0 I 0 1 0 0 
Interparoxysmal 0 0 0 0 0 0 0 0 0 0 0 0 0 0 
Homosexual 0 0 0 0 0 0 0 0 0 0 0 0 0 0 





test, are also summarized in order to provide 
an empirical estimation of the extent to which 
the appearance of such syndromes may be at- 
tributable to chance. ‘The variations of classic 
syndromes described by Szondi, as well as the 
classic syndromes themselves, were included in 
tabulation whenever and wherever they ap- 
peared. Actually all the syndromes were of the 
variational type; in no instance was a classical 
syndrome produced. In the first administration 
the nature of the data is such as to make a 
statistical comparison unnecessary, if not im- 
possible. In the one instance in which a psy- 
chopathological syndrome was produced, it ap- 
peared in the wrong group—that is to say, a 
manic syndrome appeared not in the profile of 
a manic, but of a nonpsychotic homosexual. 


Table 2 describes the frequency with which 
these pathological syndromes appear in the 
second administration profiles of the psycho- 
pathological groups and the normal group on 
both the Szondi and control tests. Psycho- 
pathological profiles in the psychopathological 
groups appear six times in the second adminis- 
tration of the Szondi test, but this again 
could very easily be a consequence of chance 
since they appear seven times in the profiles of 
the control test. 


Let us examine the occurrence of these syn- 
dromes on both administrations. It might or- 
dinarily be expected that a syndrome would 
appear in greatest frequency in the profiles of 
individuals whose diagnostic classification is 
associated with the syndrome in question. 
Thus, it would be anticipated that the melan- 


in the profiles of the depressive group, the 
manic syndrome would predominate in the re- 
cords of the manic group, the interparoxysmal 
and postparoxysmal syndromes would charac- 
terize the epileptic group, the syndrome of 
schizophrenic dissociation would predominate 
in the records of the paranoid schizophrenic 
and catatonic schizophrenic groups, and the 
male homosexual syndrome would be most 
frequently produced by the homosexual group. 
In addition, it w ,uld be expected that the mean 
frequency of appearance of the full-blown psy- 
chotic syndrome for the five psychotic groups 
would exceed the prorated value for the nor- 
mal group. 


An inspection of the tables describing the 
performance of the psychopathological groups 
on the two administrations of the Szondi test 
reveals that: 

1. The full-blown psychotic, schizophrenic 
dissociative, male homosexual, and interpar- 
oxysmal syndromes never occurred. 


2. The melancholic syndrome was elicited 
once, but in an epileptic rather than a depres- 
sive. 

3. The postparoxysmal syndrome was elic- 
ited once, but from a catatonic rather than an 
epileptic. 

4. The manic syndrome occurred most fre- 
quently—five times, but only once in a manic. 


Thus, only once in two administrations of 
the Szondi test to 72 psychopathological sub- 
jects did a syndrome appear in the expected 
clinical grouping. If the manic syndrome is 


cholic syndrome would appear most frequently eliminated from consideration, psychopatho- 
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logical syndromes appear only twice in both 
administrations, and these not in their ex- 
pected clinical groupings. 

These findings do not support the validity 
of the test, particularly with respect to the 
pathognomic characteristics of alleged syn- 
dromes. But if the acquisition of additional 
certitude is still desired, it may be obtained as 
follows: If the syndromes are invalid, they 
may be considered as chance occurrences. If 
they are determined fortuitously, it might be 
expected that there be a quantitatively and 
qualitatively similar elicitation of syndromes 
on the control test as on the Szondi test. A 
comparative analysis of performance on both 
administrations of both tests reveals that: 

1. Psychopathological syndromes were pro- 
duced by the psychopathological groups seven 
times in the Szondi test and nine times in the 
control test. 


2. The four syndromes that did not occur 
in the Szondi records of psychopathological 
subjects did not occur in the control records. 

3. The three syndromes that were produced 
on the Szondi test were produced on the con- 
trol test. 

4. The syndrome most frequently elicited 
from the psychopathological subjects on the 
Szondi test (manic — five times) was most 
frequently elicited on the control test and ap- 
peared in equal number on the control test. 


In so far as there was found no indica- 
tion of correlation between clinical groupings 
and their putative syndromes, it was considered 
advisable to proceed with an analysis of signs. 
The purpose of such an analysis was the de- 
tection of syndromic trends. That is, the anal- 
ysis of signs was supposed to make clear the 
extent to which there exist in the test per- 
formances of appropriate clinical groupings 
tendencies to classical syndromes short of their 
complete occurrence. Hence, a sign is con- 
sidered as a directional element of a classical 
syndrome. 

Thus, since the classical manic syndrome is 
+ Ils, —k, Od, —m, the sum of the frequencies 
with which these directional reactions were 
produced by any clinical group was considered 
an indication of the degree to which a manic 
syndromic trend was manifested in the group. 

In order not to obscure the comparative per- 


Table 3 
Pathological Signs on the First Administration of 
the Szondi Test 











Subjects 
Syndromes Psychopathological Nor- 
se 8 £2 € @ mal 
Melancholic mo @& 7 FF tm 
Manic 9 16 11 14 11 12 25 
F.B. psychotic > @2s 8 6235. 2 
Schizophrenic 41 38 28 34 35 31 76 
Postparoxysmal mo wmeHw & ste 
Interparoxysmal > As @ 3 2B 
Homosexual 46 28 31 33 37 34 81 





Table 4 


Pathological Signs on the Second Administration of 
the Szondi Test 





Subjects 





Syndromes Psychopathological Nor 

h e k p dad ™ mal 

Melancholic 0 18 12 #8 10 «8 39 
Manic 16 10 13 12 11 11 22 
F.B. psychotic 3 . < &» & ‘> 
Schizophrenic 38 31 30 33 #31 #28 77 
Postparoxysmal a + a Ss US lhe 
Interparoxysmal a a wee Beg 
Homosexual 38 35 27 35 33 32 90 


formances on each administration, Table 3 pre- 
sents the data for the first administration, and 
Table 4 for the second administration. Table 
5 gives the combined data for both adminis- 
trations. In order to compare the combined 
performances of the normal group with each 
of the psychopathological groups, the normal 
values have been prorated for groups of 12. 
Where a syndromic trend, as inferred from the 
production of signs, exceeded, in its appropri- 
ate clinical grouping, the values for the trend 
in the other psychopathological groups and 
the prorated normal group, chi square was 
used as an indication of the extent to which 
the obtained distribution may be explained as 
a chance occurrence. 

When working with such combined values, 
there is the possibility that the obtainment of 
significant probability values is influenced by 
the existence of positive correlation. If such 
values had been produced, it would have been 
necessary to compute chi squares for the sepa- 
rate distributions on each administration. 
However, since significant chi-square values 
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Table 5 
Pathological Signs on Both Administrations of the Szondi Test 
Subjects 
Syndromes Psychopathological Normal Normal x?* p 
h ¢ k p d m 12/32 
Melancholic 20 21 20 15 19 17 83 31.1 
Manic 25 26 24 26 22 23 47 17.6 
F.B. psychotic 9 11 14 16 8 4 29 10.9 
Schizophrenic 79 69 58 67 66 59 153 57.4 
Postparoxysmal 19 20 20 22 15 9 3 19.9 
Interparoxysmal 1 7 5 7 3 13 } 1.5 
Homosexual R4+ 63 58 68 70 66 171 64.1 5.66 48 





* x? computed only for those signs which appear in greatest frequency in the clinical grouping with which they are 


allegedly associated. 


were not obtained, this was not necessary. The 
existence of a nonsignificant value computed 
from the data of the combined administrations 
means that rejection of the null hypothesis is 
even less justified than the obtained probabil- 
ity value indicates since it is computed from 
frequencies which are probably correlated, in 
which case the sum of squares is spuriously 
high. 


The only clinical grouping that manifested 
predominance in the production of syndromic 
signs that are reputedly correlated with it was 
the homosexual grouping, and the obtained 
chi-square value did not approach an acceptable 
level of significance. With respect to other 
syndromic trends, it was found that the de- 
pressives ranked sixth in the manifestation of 
melancholic syndromic signs, the paranoid and 
catatonic schizophrenics ranked third and 
sixth respectively in the manifestation of 
schizophrenic syndromic signs, and the epilep- 
tics were tied for second in the production of 
both postparoxysmal and interparoxysmal syn- 
dromic signs. When the mean value was com- 
puted for the five psychotic clinical groupings 
with regard to the appearance of full-blown 
psychotic syndromic signs, it was found to 
equal 10.6, which is slightly less than the pro- 
rated value for the normal group. 


Just as it is possible to achieve a more sensi- 
tive measure of the existence of syndromic 
trends through the analysis of signs, it is pos- 
sible to employ a measure of even greater sen- 
sitivity in the attempt to discover the degree to 
which such trends may have eluded detection. 
Such a measure is afforded through the use of 


the directional elements, not only of classical 
syndromes, but any acceptable syndromic vari- 
ation thereof. For convenience these directional 
elements are called subsigns so as to distin- 
guish them from signs, which are more nar- 
rowly defined. Hence, the subsigns of the 
manic syndrome are +s, +s, Os, =k, —k, Od, 
td, —d, +m, and —m. Just as with signs, 
the sum of the frequencies with which these di- 
rectional reactions were produced by any diag- 
nostic group considered an indication 
of the extent to which a syndromic trend was 
evinced in that group. However, since vari- 


+ 


was 


Table 6 


Pathological Subsigns on the First Administration 
of the Szondi Test 

















Subjects 
Syndromes Psychopathological Nor- 
si¢ fh wt @ 606 
Melancholic 15 12 18 15 13 15 61 
Manic HBS HDA’ Ss 
Schizophrenic 60 58 55 55 53 51 130 
Postparoxysmal 31 38 32 31 31 26 56 
Table 7 


Pathological Subsigns on the Second Administra- 
tion of the Szondi Test 














Subjects 
Syndromes Psychopathological Nor- 
® &« £2 ff ie ee 
Melancholic 18 20 20 15 16 16 57 
Manic 31 28 29 28 28 32 63 
Schizophrenic 60 54 56 55 51 46 135 
Postparoxysmal 29 29 29 34 24 29 65 
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Table 8 
Pathological Subsigns on Both Administrations of the Szondi Test 
Subjects 
Syndromes Psychopathologica! Normal Normal cee p 
h e k p d m 12/32 
Melancholic 33 32 38 30 29 31 118 44.2 
Manic 55 63 59 57 55 63 122 45.7 
Schizophrenic 120 112 111 110 104 100 26 99.4 
Postparoxysmal 60 67 61 65 55 55 121 45.4 9.01 18 





* x* computed only for those subsigns which appear in greatest frequency in the clinical grouping with which they 


are allegedly associated. 


ational syndromes exist for only four of the 
seven classic syndromes studied, there exist only 
four different kinds of syndromic subsigns. 

The frequencies of pathological subsigns for 
the separate administrations of the Szondi test 
are given in Tables 6 and 7, and in Table 8 
for the combined administrations. In the one 
instance in Table 8 in which predomination 
of pathological subsigns (postparoxysmal) oc- 
curred in an appropriate clinical grouping 
(epileptic), the chi-square value for the ob- 
tained distribution was not significant. As re- 
gards the other syndromes, the depressive 
group ranked last in the manifestation of mel- 
ancholic subsigns, the manic group shared first 
rank with the epileptic group in the produc- 
tion of manic subsigns, and the catatonic and 
paranoid schizophrenic groups ranked third 
and fourth respectively in the demonstration 
of schizophrenic subsigns. 


Summary and Conclusions 


It was the purpose of this study to investi- 
gate the discriminative power of Szondi’s 
syndromes by studying the extent to which they 
were differentially produced by different clin- 
ical groups. The subjects included 32 presum- 
ably normal individuals, and 72 psychopatho- 


logical individuals. ‘The latter group was com- 
prised of nonpsychotic homosexuals, psychoti 
epileptics, paranoid schizophrenics, catatonic 
schizophrenics, manic-depressive depressives, 
and manics. Each group was given two admin 
istrations of the Szondi test and two adminis 
trations of a control test that was constructed 
through the use of photographs of presumably 


normal individuals. 

‘The principal findings were as follows: 

1. Syndromes that are allegedly character- 
istic of particular clinical groupings did not pre 
dominate within these groupings, and such syn- 
dromes were produced in about equal number 
on the control test. Consequently, chance fur- 
nishes an adequate explanation of syndromic 


distributions. 
9 


hee 


Syndromic elements that are allegedly 
characteristic of particular clinical groupings 
did not, with two exceptions, predominate 
within their appropriate groupings. However, 
in neither case could the null hypothesis be re- 
futed at an acceptable level of significance. 


Received July 1, 1953. 
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The Failure of Some Rorschach Indices to Predict 
the Outcome of Psychotherapy "’ 


Lynn K. Roberts 


State Uniwersity of lowa 


A review of the literature in the spring of 
1950 failed to produce a convincing demon- 
stration of the validity or nonvalidity of the 
Rorschach technique as a prognostic instru 
ment. Nonetheless, indices based on this lit- 
erature were being used in clinical practice to 
predict outcome with treatment. 

The purpose of this study was to determine 
the relationship between eleven Rorschach in- 
dices alleged in the literature or by Rorschach 
practitioners to have prognostic significance 
and the psychiatric status of the individual at 
the time treatment was discontinued. 

The indices hypothesized to be associated 
with improvement as a result of psychotherapy 
were: (a) at least one color response (FC, 
CF, C but excluding Cn and C des); (+) 
FC — (CF + C) wt. equal to or greater than 
zero; (c) at least one M; (d) M + FM + 
m equal to or greater than three; (¢) FCh + 
F(C) + Fe + FCW equal to or greater than 
two; (f) F diff. + A + P divided by 3R with- 
in the range of .27 to .42; (g) responding to 
all plates; (hk) F+% undiff. within the 
range 75 to 90; (i) H — Hd equal to or 
greater than one; (7) W”:M within the range 
1.5:1 to 2.5:1; (4) at least one M, one FC, and 
one H. 


Method 


Subjects. The 51 subjects used in this study 
represented all of the cases in the files of the 
Mental Hygiene Unit, Veterans Administra- 


1 This study is based upon a dissertation submit- 
ted by the writer in partial fulfillment of the re- 
quirements for the Ph.D. degree in psychology. The 
writer is indebted to Professor Arthur L. Benton 
for his critical and helpful advice. 


2 From the Veterans Administration, Des Moines, 
Iowa. 


8 Now at the Mental Hygiene Unit, Veterans Ad- 
ministration Center, Des Moines, Iowa. 
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tion Center, Des Moines, lowa, who, as of 
April 1, 1950, the following criteria: 
male, 21 to 33. years of age at the time of en- 
had 


been terminated, from whom individual Ror- 


met 


tering treatment, with whom treatment 
schach protocols were obtained prior to the 
tenth treatment interview, who had Wechsler- 
Bellevue intelligence quotients above 92, who 
had been seen only on an outpatient basis for 
individual psychotherapy, concerning whom 
there was no positive evidence of significant 
central nervous system pathology, who came 
to the unit voluntarily, and who were legally 
eligible for treatment at this installation. 

The mean age of the subjects was 26.20 and the 
median, 26. 
quotients were 114. The mean number of treatment 


Both the mean and median intelligence 


interviews was 23.65 and the median, 12. The two 
or more contacts required to obtain case histories 
and test batteries were not counted as treatment in 
In 


initial 


terviews. 
the treatment 
had one treatment interview before the 
was administered; three, : three, 

four; two, five; two, six; and one, nine. 


36 cases the Rorschach was given be 
Three cases 
Rorschach 


three; 


fore interview. 


two one, 

Four veterans had service-connected diagnoses of 
psychoneurosis, unclassified; 2, hysteria; 24, anx- 
iety state; 3, re- 
action (asthma, colitis, and dermatitis) ; 1, psycho- 
sis, unclassified; 4, dementia praecox; 2, paranoid 
schizophrenia; 2, manic-depressive psychosis; 1, 
psychosis with depression; 1, hepatitis; 1, mastoid; 
and 1, flat feet. The last three were eligible for 
treatment for nervous conditions, although not serv- 
ice connected for such, due to the fact that they 
were under rehabilitation training. One was treated 
for mixed neurosis; 1, anxiety state; and 1, psycho- 
pathic personality. Two of the cases were neither 
service connected nor under rehabilitation but were 
treated on the presumption that their claims would 
be adjudicated as service connected, 1 for phobic 
reaction and 1 for anxiety state. 


mixed neurosis; 3, somatization 


Procedure. After the removal of all refer- 
ences to psychological test material, the de- 
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tailed record of individual interviews for each 
subject was rated by three judges on three 
scales for both pretreatment and posttreatment 
psychiatric status. ‘Ihe scales, each having four 
points, represented three attributes of psychi- 
atric status: work maladjustment, symptom 
atology, and pathological attitudes. Each judge 
was requested to support each rating by state 
ments from the records concerning the sub- 
ject’s behavior. ‘Lhe ratings were made inde- 
pendently by a psychiatrist, a psychologist, and 
a social worker with ten or more years’ ex- 
perience in their respective fields. 


Obtained product-moment correlation coefh- 
cients between judges and between scales were 
positive, significant beyond the .0O1 confidence 
level and appeared to justify their combination 
into total ratings for pretreatment and post- 
treatment total ratings were 
found to be uncorrelated. ‘The difference be- 
these total ratings was found to be 
negatively correlated with the pretreatment 
total ratings at the .O5 confidence level, and to 
be positively correlated with the posttreatment 
ratings at the .0O1 confidence level, which ap- 
peared to indicate that for practical purposes 


status. ‘These 


tween 


the use of the posttreatment ratings as indices 
of improvement or response to psychotherapy 
was justified. 

As a check on the assumptions made in com- 
bining the nine posttreatment ratings for each 
individual, an analysis of the variance of these 
posttreatment ratings was done by the method 
indicated by McNemar [5] as a “special case 
where blocks stand for people.” The results in- 
dicated that, while the combination of the rat- 
ings of the three judges was permissible, the 
combination of the three scale ratings was a 
dubious procedure. Therefore, the sums of the 
three judges’ ratings for each individual on 
each of the three scales were used as three cri- 
terion groups. 


The average difference between the pretreat- 
ment and posttreatment ratings of the three 
judges, to the nearest scale point, gave one 
measure of response to psychotherapy. In terms 
of the work maladjustment scale, 2 cases be- 
came worse by one scale point, 27 showed no 
change, 17 improved by one scale point, 4 
improved by two scale points, and 1 improved 
by three scale points. In terms of the symp- 


tomatology scale, | case became worse by one 
scale point, 23 showed no change, 21 improved 
by one scale point, 5 improved by two scale 
points, and | improved by three scale points. 
In terms of the pathological attitude scale, | 
case became worse by one scale point, 3! 
showed no change, 17 were improved by one 
scale point, and 2 were improved by two scale 


points. 


‘The Rorschach protocols were rescored by 
the writer. Lhe Beck lists [ 1 | were consulted 
as to the form quality of all responses not in- 
cluded in the Hertz tables [4|. ‘lo insure con 
sistency, the responses of all individuals to one 
Rorschach plate were scored before proceeding 
to the next plate, and records were kept of all 
responses not included in the above tables as 
well as the scoring assigned them. 

As there was an odd number of cases, the 
larger number of cases was consistently as 
signed to the upper half of the criterion groups. 
‘The chi-square test of independence was used 
with the 1 per cent level of confidence estab- 
lished as the significant region of rejection. 


Results and Discussion 


As all but one of the 51 subjects gave at 


least one color response, it was impo sible to 
test the first hypothesis with this group. 
Using each of the three scales as the cri- 
terion it was necessary to accept the null hy- 
pothesis as to the relationship between each 
criterion and each of the ten testable hypoth- 
eses. [he hypothesis with which it was most 
nearly possible to reject the null hypothesis 
seemed to be a reversal of the second (FC 
[CF 
which gave: with work maladjustment ratings 
a chi square of 6.396, probability range .02- 


C| wt. equal to or greater than zero) 


.01; with symptomatology ratings a chi square 
of 6.296, probability range .02—.01; and with 
pathological attitude ratings a chi square of 
3.732, probability range .10—.05. 


The findings of this study most nearly paral- 
lel those of Harris and Christiansen [3] who 
stated that the average Rorschach scores for 
the upper and lower halves of their total group 
were not significantly different. Since the com- 
pletion of this study, similar results have been 
reported by Filmer-Bennett [2] and Rogers 
and Hammond [7]. 





98 Lynn K. 


7 


Of the Rorschach factors tested, only the 
color responses seem to warrant further inves- 
tigation. In this respect it appears that the FC 
responses may be negatively related to im- 
provement while the CF and C responses may 
be positively related to improvement with psy- 
chotherapy. This would seem to parallel, in 
part, the statement of Piotrowski [6] that the 
best single Rorschach criterion of improvement 
with hospitalized schizophrenic patients was 
the “meaningful” color response. 


Summary 


Eleven Rorschach factors alleged to have 
predictive significance for the outcome of 
treatment when tested against three scales of 
improvement with psychotherapy failed to 
meet the level of confidence established as the 
significant region for rejection of the null hy- 
pothesis. Of the factors tested, only some com- 
bination of the color responses appears to war- 
rant further study. 


Received July 27, 1953. 
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Projected Familial Attitudes as a Function of 
Socioeconomic Status and Psychopathology 


Jerome L. Singer 
Franklin D. Roosevelt VA Hospital, Montrose, N. Y.:* 


Most personality theories stress the fact that 
the early familial experience of the child pro- 
vides the basis for long-standing values, goal 
orientations, and personality patterns in gen- 
eral. The peculiar pattern of a given family 
constellation is a function, to a great extent, 
not only of the specific psychological relation- 
ships of the parental figures, but of the par- 
ticular sociocultural group in which the family 
participates. ‘This statement implies that by lo- 
cating a family within a particular social en- 
vironment, ¢€.g., socioeconomic class, ethnic or 
religious group, we are in a sense somewhat 
limiting the variations in familial experience 
available to the child. Research in child-rearing 
practices, for example, has demonstrated strik- 
ingly different patterns of behavior for differ- 
ent subcultural groups within our population 
[1, 2, 3]. More recently, Mitchell [9, 10], 
building on Henry’s use of projective test 
materials in subcultural research [6], has at- 
tempted to delineate differences in the familial 
experience patterns of normals as a function of 
socioeconomic status (middle and lower class) 
and racial group (Negro and white). Using 


1 Reviewed in the Veterans Administration and 
published with the approval of the Chief Medical 
Director. The data and opinions presented are the 
results of the author’s own work and do not reflect 
the policy of the Veterans Administration. 


2The author is indebted to Dr. Howard E. 
Mitchell of the Philadelphia VA Clinic who per- 
mitted use of unpublished data and made help- 
ful comments concerning the problem; to Mr. 
Aaron Leve, Clinical Psychologist Trainee, who 
assisted in collection of some of the data and in 
ratings of protocols; to Dr. Sheldon J. Korchin, 
who first suggested the implications of this type of 
research; and to staff members and volunteer work- 
ers from this station who are participating in vari- 
ous phases of the research program. 


°A portion of this paper was presented at the 
meetings of the American Psychological Association, 
Cleveland, Ohio, 1953. 


the Thematic Apperception ‘Test, Mitchell 
analyzed protocols of his four subgroups along 
fairly objectively scored dimensions. Results 
indicated a large number of significant social 
class differences in identification of adult fig- 
ures, characterization of familial figures, in 
dications of familial motivation and its out 
comes, and degree of means end cognizance’. 
Racial group differences also emerged but in 
general were less striking than those between 
social class groups. 

Quite apart from the specific results ob- 
tained, Mitchell’s investigation seems impor- 
tant as a demonstration of the methodological 
utility of projective methods in the area of so- 
cial factors in personality development. The 
study to be described here represents a pre- 
liminary effort to extend this method to the 


borderland of 


social and clinical psychology. 
More specifically, this study attempted an ex- 
ploratory survey of the extent to which famili- 
al attitudes, expressed through the medium of 
TAT stories, are determined by participation 
in a common sociocultural background or by 
participation in the particular family constella- 
tion presumably conducive to the development 
of schizophrenia. If indeed ‘“schizophreno- 
genic” family constellations do exist, as sug- 
gested by studies of the parents of pa- 
tients [5, 8, 11, 12, 14], this common famili- 
al experience should be reflected to some 
extent in the schizophrenics’ perception of 
family inferred through the medium of the- 
matic projections. The question raised in this 
study is whether schizophrenic patients stem- 
ming from contrasting socioeconomic back- 
grounds will reveal predominantly those social 
class differences described in previous studies 
or whether they will cut across social class 
lines to reflect familial attitudes common to 
their personality disturbance and different 
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from those of normal persons. The present in- 
vestigation represents a preliminary effort as 
part of a larger program and will be restricted 
to a comparison of Mitchell’s normal group 
with a schizophrenic sample. 


The Experiment 
Hypotheses 


1. If schizophrenia represents a serious dis- 
turbance in interpersonal relations rooted in 
early failures of identification with parental 
figures and deep-seated feelings of rejection 
[4, 13], schizophrenic adults should manifest 
certain common familial attitudes irrespective 
of their social class differences. Within the 
limited categories studied here these should 
take the form compared with normals of less 
identification of adult figures as familial or 
parental, greater characterization of parental 
figures as “cold or rejecting,” greater charac- 
terization of intrafamilial situations as “cold,” 
and greater expression of problems in getting 
along with others. The concreteness and inse- 
curity of the schizophrenic may be manifested 
in stories revealing ambivalence or failure in 
attainment of socially approved goals as well 
as in less expressed awareness of practical 
measures necessary for accomplishment 
(“means-end cognizance” ). 


2. Even if the above hypotheses are sup- 
ported, certain social class differences may still 
emerge. If descriptions of middle-class family 
life are accurate, the tighter-knit familial 
structure of this group should be reflected to 
some extent in the stories of schizophrenics as 
well as those of normals. More specifically, we 
may expect, as Mitchell [9] found, more men- 
tion of parental motivation on the part of the 
middle-class subjects. Similarly, the greater 
parental control in the middle class tends to 
structure more rigidly the time perspective of 
the child [3, 7]. Hence the degree of ‘‘means- 
end cognizance” for socially approved goals 
expressed in the stories of middle-class sub- 
jects should prove greater than that of 
lower-class subjects. A similar consequence of 
this more closely knit family structure might 
be greater identification with the father-figure 
in the middle-class group, manifested perhaps 
by ascription of warmer characteristics to 
fathers or older adult males in thematic mater- 
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ial. A trend in this direction was found by 
Mitchell [9], middle-class Ss identifying more 
adult figures as “fathers” and characterizing 
them more often than lower-class Ss as ‘‘com- 
forting or friendly.’ Thus, even if schizo- 
phrenics generally describe older adult figures 
on the TAT cards as “cold or rebuking,” 
there might be a tendency for middle-class pa- 
tients to resemble middle-class normals to 
some extent by manifesting closer paternal 
identification. 


Subjects 

Schizophrenic patients of contrasting social 
class groups were selected for comparison with 
Mitchell’s sample, which involved 40 middle- 
and 40 lower-class normal white males. ‘The 
final group consisted of 60 officially diagnosed 
schizophrenic white male veterans, predomi- 
nantly paranoid in type, who met Mitchell’s 
criteria for socioeconomic status. The three 
chief criteria were educational level, occupation 
of subject, and father’s occupation at time § 
was a child. The lower-class group consisted 
of 30 patients whose mean age was 33.2 years, 
mean educational level 8.35 years, occupation- 
al groupings almost completely within the la- 
boring fields, and whose fathers’ work had 
been unskilled labor, construction work, short- 
order cooking, etc. Although Mitchell’s edu- 
cational upper limit had been eighth grade, 
slight differences in the educational require- 
ments for the New York area compared with 
Philadelphia necessitated raising this limit to 
ninth grade. In two cases patients with some 
tenth-grade work were included when a check 
of social history data made it clear that they 
met other criteria for lower socioeconomic 
class status. Since only clear-cut cases were 
employed, accumulation of the lower-class 
sample was comparatively slow. 


The middle-class sample consisted of 30 
schizophrenics whose mean age was 29.9 years, 
mean educational level 13.3 years, occupations 
those of college students, artists, engineers, and 
technical or professional and semiprofessional 
fields, and whose fathers were professional, 
managerial, self-employed business people, etc. 
Where possible, additional criteria such as in- 
come, neighborhood, and dwelling were em- 
ployed to insure clear separation of the two 
socioeconomic groups. 
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The schizophrenic groups were thus quite 
comparable to Mitchell’s normals. The dif- 
ference of three years in the average ages of 
the normals and patients seems of little prac- 
tical significance. The factor of general intel- 
ligence was apparently not considered in Mit- 
chell’s sampling. Although intelligence data 
were not available for all schizophrenics, clear- 
ly defective patients were eliminated. The 
final grouping revealed a slight intellectual ad- 
vantage for the middle-class group with both 
patient samples, however, proving somewhat 
above average in IQ. Although Mitchell’s was 
clearly an urban sample, this factor could not 
be completely controlled in the schizophrenic 
samples and undoubtedly resulted in some ad- 
ditional variability, although apparently not to 
any excessive degree. 


The schizophrenic patients were all serious- 
ly ill, clearly diagnosed cases with delusional 
and hallucinatory experiences, seclusiveness, 
and other schizophrenic symptomatology. 
There was no reason to believe from examina- 
tion of case histories that any extraneous symp- 
tom differentiated the social class groups. Fol- 
lowing Mitchell’s criteria only those patients 
who had spent their formative years in a family 
setting were included; patients with foster- 
home backgrounds, institutional care, or early 
separated parents were therefore eliminated. 
Also eliminated were those whose verbalization 
was either too bizarre or too sparse to provide 
objectively scored protocols. 


Procedure 

The Ss responded to Cards 1 BM, 2, 6 BM, 
and 7 BM of the Thematic Apperception Test 
in accordance with the usual instructions. In 
the case of patients who received the test as 
part of clinical examination, material elicited 
after probing by the examiner was eliminated 
from consideration. As in Mitchell’s work, 
protocols were entered on 5 X 8 in. cards 
identified only by a code number to eliminate 
bias in ratings. 

The author served as the sole rater for ex- 
perimental data. Since he had been trained as 
a rater for Mitchell’s original analyses, this 
further enhanced the likelihood of comparing 
Mitchell’s normals with the schizophrenic 
samples. As a check on reliability, however, an 
assistant was trained in the rating scheme, and 
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both he and the author rated a series of proto- 
cols from patients who failed to meet the cri- 
teria. Since agreement was obtained in over 
90% of the ratings, it was felt that individual 
ratings would suffice for the analysis. 

The data were analyzed in accordance with 
the scoring scheme employed by Mitchell. ‘The 
categories were as follows (in abbreviated 


form) : 
Card 1 BM 

1. Designation of auxiliary figures, (e.g., fam- 
ilial, including parents, siblings, etc.; nonfamilial, 


including uncles, teachers, doctors; unspecified fig- 
ures; none mentioned). 

2. Source of hero’s motivation, (e.g., familial, non- 
familial, unspecified, hero self-motivated). 

3. Degree of “means-end 
some, high, no goals). 


cognizance,” (none, 
4. Attainment of goals, (e. g., attained, not at- 
tained, ambivalent, indeterminate, etc.). 
5. Motivating methods employed by auxiliary fig- 
ures, (€. g., aggressive, nonaggressive, 
minate, hero self-motivated). 


Card 2 
1. Designation of hero 


indeter- 


2. Designation of auxiliary figures 
Card 6 BM 

1. Designation of hero 

2. Designation of auxiliary figures 

3. Characterization or description of auxiliary 
figure (e. g., comforting, adequate, reliable, or 
emotionally stable individual; rebuking, inadequate, 


undependable or maladjusted individual; mixed; 
indeterminate). 


4. Feeling tone or atmosphere of interpersonal re- 
lationship (e. g., warm, satisfying, harmonious; 
cold, disagreeable, hostile, incompatible; 
neutral; indeterminate). 


mixed ; 


5. Nature of problems discussed (e. g., personal 
adjustment; relationship with others; environmental 
lacks or pressures; indeterminate ; etc.) 


Card 7 BM 
(Categories identical with those of 6 BM) 


The data were analyzed by the use of chi 
square to evaluate the dependence of an ob- 
tained frequency in a given scoring category 
upon the social class or psychopathological 
dichotomy. Where expected frequencies fell be- 
low five, the correction for continuity was em- 
ployed. In those comparisons in which specific 
directions of differences were hypothesized, the 
value of »/2 was employed to obtain signifi- 
cance levels. 
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Results 


On the basis of comparison of Mitchell's 
normal white sample with the schizophrenic 
sample the following significant findings or 
marked trends emerged: 

1. Identification of adult figures 


Where adult figures appear in cards, 17% of 
schizophrenics’ stories and only 1% of normals’ 
stories failed to identify these as familial or non- 
familial authorities. (x? —= 36.9; p < .001) 


2. Motivations for socially desirable goals (Card 
1 BM) 

a. 21% of normals and no schizophrenics 
failed to mention specific goals in their stories. (x? 
= 12.2; p < .001) 

b. 72% of schizophrenics and 41% of normals 
represented the hero as self-motivated. (x? —= 12.2; 
p/2 < .001) 

c. 14% of normals and 37% of schizophrenics 
expressed ambivalence about goal attainment. (x? 
== $9; 6 = 85) 

d. 32% of schizophrenics and only 16% of 
normals revealed mo “means-end cognizance” for 
goal attainment. (x? = 11.7; p/2 < .001) 

e. 25% of middle-class normals and only 7% 
of middle-class schizophrenics revealed high “means- 
end cognizance” for goal attainment. (x? = 4.01; 
p/2 = .02) 


3. Characterization of adult figures in Cards 6 
and 7 

a. 24% of normals and only 5% of schizo- 
phrenics characterized the “mother-figure” as “com- 
forting” etc. (x? = 9.1; p < .01) 

b. 66% of normals and 80% of schizophrenics 
characterized the “mother-figure” as “rebuking” or 
“mixed.” (x? = 2.55; p/2 > .05 < .10) 

c. 68% of normals and only 54% of schizo- 
phrenics identified the adult in Card 7 BM as 
“father.” (x? = 2.71; p/2 = .05) 

d. 70% of normals and only 54% of schizo- 
phrenics characterized the older adult male in Card 
7 as “comforting.” (x? = 3.8; p/2 < .05 > .01) 

¢. 21% of schizophrenics and 8% of normals 
characterized the older adult, “father-figure” as “re- 
buking.” (x? = 5.5; p/2 = .01) 

f. 45% of normals and only 31% of schizo- 
phrenics characterized the interpersonal relationship 
between younger male and “father-figure” on Card 
7 BM as “warm.” (x? = 2.71; p/2 = .05) 

g. 48% of normals and 62% of schizophrenics 
characterized the interpersonal relationship on Card 
7 BM as “cold” or “mixed.” (x2==2.7; p/2— .05) 

h. 68% of lower-class normals and only 41% 
of lower-class schizophrenics described the older 
adult figure in 7 BM as “comforting.” (x? — 4.6; 
’ < 05 > .01) 


4. Type of problem discussed (Cards 6 and 7) 
a. 25% of normals and only 7% of schizo- 
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phrenics expressed problems in Card 6 of “personal 
adjustment.” (x? — 7.9; p < .01) 

b. 34% of schizophrenics and only 23% of 
normals described problems in “interpersonal rela- 
tionships” on Cards 6 and 7. (x? — 4.08; p < .05 
> .02) 


The following social class differences, based 
upon combination of Mitchell’s normals of 
two socioeconomic levels with middle- and 
lower-class schizophrenics emerged as signifi- 
cant or showed strong trends: 


1. Motivations for socially desirable goals (Card 
1 BM) 

a. 67% of middle-class Ss introduced adult 
figures into Card 1 BM compared with only 43% 
of lower-class Ss. (x? = 10.8; p < .001) 

b. 60% of lower-class and 48% of middle- 
class Ss described the hero as self-motivated. (x? —= 
2.4; p/2 < 10 > .05) 

c. 36% of middle-class and only 19% of 
lower-class Ss indicated presence of family motiva- 
tion. (x? == 5.2; p/2 < .02 > .01) 

d. 43% of lower-class and only 11% of mid- 
dle-class Ss revealed no “means-end cognizance” for 
goal attainment. (x? — 9.8; ~/2 < .01) 

e. 17% of middle-class and only 3% of lower- 
class Ss revealed a high degree of “means-end cog- 
nizance.” (x2 = 7.9; ~p/2 < .01) 

f. 72% of lower-class schizophrenics and only 
13% of middle-class schizophrenics revealed no 
“means-end cognizance.” (x? — 11.7; p~ < .001) 

g. Although socioeconomic groups did not dif- 
fer in mention of “aggressive” motivational tech- 
niques, 20% of middle-class and only 1% of lower- 
class Ss mentioned “nonaggressive” motivational 
methods. (x? == 10.6; » < .01) 


2. Characterization of adult figures in Cards 6 
and 7 

a. 25% of lower-class and 38% of middle- 
class Ss attributed both positive and negative char 
acteristics to the interpersonal relationships between 
hero and “mother-figure.” (x? == 2.74; p/2 == 
.05) 

b. 23% of middle-class schizophrenics and only 
7% of lower-class schizophrenics characterized the 
“mother-figure” as having positive as well as neg- 
ative qualities. (x? == 3.27; p > .05 < .10) 

c. 70% of middle-class Ss and only 56% of 
lower-class Ss characterized the “father-figure” as 
“comforting.” (x2?==2.7; p/2==.05) 

d. 67% of middle-class schizophrenics and 41% 
of lower-class schizophrenics characterized the 


“father-figure” as “comforting.” (x2 = 3.6; p/2 
> 01 < .05) 

e. 31% of lower-class Ss and only 19% of mid- 
dle-class Ss described the atmosphere of the inter- 
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personal relationship between hero and older male 
adult as “cold.” (x? = 3.1; p/2 < .05 > .01) 


f. 46% of middle-class Ss and 32% of lower- 
class Ss described the atmosphere of the interperson- 
al relationship between hero and older male as 
“warm.” (x? = 2.74; p/2 — .05) 


Discussion 


The results in general, although limited by 
the size of samples and the relative super- 
ficiality of scoring categories, tend to support 
the hypotheses. Particularly clear-cut are the 
differences between schizophrenics and nor- 
mals. To the extent that their TAT stories re- 
flect deep-seated feelings, the schizophrenics 
portray themselves as relatively isolated from 
parental figures, whom they see as cold or re- 
jecting. The patients more often than normal 
Ss must motivate themselves toward socially 
acceptable goals but they are unsure of the out- 
come of their striving and are considerably 
less aware of the practical steps necessary for 
goal achievement. Their problems appear bas- 
ically those of “separation from familial fig- 
ures,” unlike the normal Ss who are concerned 
more with personal advancement and achieve- 
ment, for example. The schizophrenics of both 
social classes resemble the lower-class normals, 
particularly in their greater isolation from 
close parental relationships. Their lower 
“means-end cognizance” suggests the narrower 
time-perspective, the inability to sustain ten- 
sion or defer gratification reported to be char- 
acteristic of lower-class individuals [3, 7, 9]. 
The few studies of schizophrenics’ parents have 
suggested patterns of domination by covertly 
rejecting, dominating mothers with fathers 
playing passive roles [5, 8, 11, 12]. This re- 
jection and paternal isolation is reflected in the 
patients’ projections, the older adult in Card 7 
BM being less often identified as a father, for 
example. At the same time this “father-surro- 
gate’’ is seen by patients more frequently in a 
negative way, a finding all the more striking 
in view of the fact that the stimulus itself 
tends to structure a comparatively favorable 
impression of the older figure. 

The social class differences obtained are 
generally in accord with those reported by 
Mitchell [9], e.g., greater self-motivation and 
lower “means-end cognizance” manifested by 
lower-class Ss and somewhat more positive pa- 
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ternal relationships for the middle-class group. 
These differences in individuals’ impressions of 
the family reflect, it would seem, the differ- 
ences in parental control and closeness for the 
two social class groups, and particularly for 
the middle-class, the stronger position of the 
father. In the middle socioeconomic group, the 
father is not only more available to the child 
for identification but is likely to be somewhat 
more successful in achievement. This appears 
to be the case even for the middle-class schizo- 
phrenics. The differences within the total 
schizophrenic sample seem to mirror just this 
factor of differential parental control and 
greater parental availability. Yet, on the 
whole, the middle-class schizophrenics like 
their fellow patients from the lower socioec- 
onomic background, see their parents as rebuk- 
ing, cold, or aloof. Lacking warm intrafamilial 
feelings or guidance they too manifest, albeit 
less clearly, largely self-motivation with little 
awareness of necessary procedures for goal at- 
tainment, which is characteristic of 
class individuals. 


lower- 


The results of this study, while in them- 
selves not striking, do suggest the value of fur- 
ther exploration of social class factors in per- 
sonality development and psychopathology. Re- 
search under way at this hospital is now being 
directed toward more refined and dynamic ex- 
ploration of patterns of familial response as ex- 
pressed both through “questionnaire’”’ and “‘pro- 
jective” devices. The finding of socioeconomic 
class differences in family constellations also 
has clinical import in interpretation of test 
data. Many additional social factors de- 
limiting the variability of family constellations 
merit consideration for a full understanding 
of the meaning of a particular pattern of re- 
sponse to a test like the TAT, for example. The 
problem of determining the manner in which 
religious, national, ethnic, and geographical 
factors alter family constellations and influence 
the projective test performance of the individ- 
ual offers a distinct challenge to clinical psy- 
chology research. 


Summary and Conclusions 
1. This investigation represented a pilot 
study in a program of research designed to 
consider the role of social and cultural factors 
in the familial attitudes of normal and patho- 
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logical groups. It was essentially a supplement 
to Mitchell’s [9] investigation of responses to 
Thematic Apperception Test family pictures 
of white adults and Negroes of middle- and 
lower-class socioeconomic status. By obtaining 
a group of schizophrenic patients of two social 
class levels comparable to Mitchell’s normal 
white samples, hypotheses concerning the in- 
fluence upon themes of both socioeconomic 
status and psychopathology were set up in ac- 
cordance with recent research and theory. 


2. The Ss were 30 white male schizophrenic 
patients who met Mitchell’s criteria for lower- 
class status and 30 patients who qualified as 
middle-class. The groups were as extreme as 
feasible and there was no overlap on the three 
main criteria, education, S’s occupation, and 
father’s occupation. These patients were com- 
parable to Mitchell’s 40 middle-class and 40 


lower-class normals. 


3. All Ss were administered Cards 1 BM, 
2, 6 BM, and 7 BM from the TAT. Stories 


were analyzed in accordance with a series of 
relatively objectively scored categories includ- 
ing source and nature of motivations, character- 
ization of auxiliary figures, atmosphere of inter- 
personal relationships, types of problems 
raised, etc. Chi-square analysis was employed 
to test significance of frequencies obtained as a 
function of social class or psychopathological 
grouping. 


4. Although certain of Mitchell’s findings 
concerning social class influences were con- 
firmed, the most numerous and marked diftfer- 
ences were between schizophrenics and nor- 
mals. Patients introduced fewer family figures 
into themes and presented a picture of isolation 
from parental figures. They saw both maternal 
and paternal surrogates as more frequently 
“rebuking” and less often “comforting” than 
normals. Although identifying socially desir- 
able goals more frequently, patients showed 
ambivalence about goal attainment and less 
awareness of steps necessary for such attain- 
ment. As hypothesized, middle-class Ss pro- 
jected more familial motivation into stories 
and showed more “means-end cognizance”’ 
than lower-class groups. Although both nor- 
mal and schizophrenic middle-class groups 
showed more positive paternal relationships, 
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the schizophrenics on the whole gave evidence 
of more disturbed intrafamilial relationships 
in their projections. Implications for clinical 
psychology and research on subcultural factors 
influencing the family pattern were discussed. 


Received July 20, 1953. 
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Earlier reports [6, 7] have indicated that 
the incomplete sentences method may be used 
to provide a group or individual test that 
would retain some of the advantages of a pro- 
jective technique and at the same time be 
amenable to objective scoring. The history and 
a more detailed description of the advantages 
and disadvantages of the incomplete sentences 
method may be found in Bell [1], Rohde [3], 
and Rotter [4]. 

Validity studies of the objective scoring of 
one of the sentence completion tests, the In- 
complete Sentences Blank (ISB), for the 
screening of patients in a convalescent hospital 
and for college screening have previously been 
reported [6, 7]. The present study is con- 
cerned with the development of a scoring man- 
ual for degree of conflict or maladjustment and 
the preliminary test of the validity of the High 
School Form of the ISB. Use of the ISB, High 
School Form, for individual clinical evalua- 
tions is described in the Manual for the In- 
complete Sentences Blank, College Form [5, 
pp. 47-50]. 


The Incomplete Sentences Blank, 
High School Form 


The High School Form is very similar to 
the College and Adult Forms. Six of the items 
differ from the College Form so that they are 
more appropriate for the younger age group. 
The test instructions and the 40 stems are 
shown in Fig. 1. 


The test may be administered to a group of 
any size. No instructions are given except to re- 
peat the printed instructions and to urge sub- 
jects to complete all the items. The approxi- 
mate average time for administration is 25 
minutes. 
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Complete these sentences to express your real feel- 
ing. Try to do every one. Be sure to make a com- 
plete sentence. 





h. 2M 6 «0 21. I failed... 

2. The happiest time... 22. Reading... 

3. I want to know... 23. My mind... 

4. At home... 24. The future... 

5. I regret... OE. ROB.i « « 

6. At bedtime .. . 26. Dating... 

7. Boys... 27. I am best when . 

8. The best... 28. Sometimes... 

9. What annoys me... 29. What pains me.. 

10. People... 30. I hate... 

11. A mother... 31. At school... 

se ae 32. I am very... 

13. My greatest fear... 33. The only trouble... 

14. In the lower 34. I wish... 
grades... 35. My father... 

aS. E can’t... 36. I secretly... 

16. Sports... 3S7. I. 

17. When I was 38. Dancing... 
younger... 39. My greatest 

18. My nerves... worry is... 

19. Other kids... 40. Most girls... 

20. I suffer... ; 





Fig. 1. The Incomplete Sentences Blank, High 
School Form. 


Development of Scoring Manuals 


Scoring manuals for the high school popu- 
lation were developed using methods similar to 
that utilized in the development of the Air 
Force Manual [7] and the College Form 
Manual [5]. This method is described in more 
detail in the earlier articles. In outline, it con- 
sists of : (a) Collecting case material on a num- 
ber of subjects with an emphasis on a thorough 
clinical understanding of each case rather than 
a large number of cases. (5) The selection of 
sentence completions to be used as examples 
for scoring each item on a seven-point scale 
which includes responses indicating three de- 
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grees of conflict or unhealthy adjustment, 
neutral items, and items indicating three de- 
grees of ‘ealthy adjustment. The sample re- 
sponses are carefully studied so that principles 
may be drawn from them, and, in addition, pre- 
vious experience with this instrument, as well 
as clinical information about each case, is used 
to determine whether any given response of 
any given subject will be utilized as a scoring 
example and at what level of adjustment. (c) 
The manuals which now include scoring ex- 
amples for each item (separate manuals for 
boys and girls) are then tried out on a new 
sample of cases from another source to deter- 
mine their adequacy and comprehensiveness. 
(d) A cross validation or a test of validity is 
made on new groups, the scoring done by per- 
sons who have no outside information about 
each case. 


The samples from which the present test was 
developed and partially cross validated was 
an entire population of a high school (High 
School A) in the vicinity of Columbus, Ohio. 
This high school, socioeconomically, was prob- 
ably slightly above the average of this area. 
The total population of the'school was approx- 
imately 400. 

The test was administered to the whole 
school population on the same day. Subse- 
quently this sample was divided in half, half 
being used for criterion purposes and half for 
cross validation. In each instance there was 
equal representation from all four year levels. 
In addition to this criterion group, in order to 
provide more clear-cut cases of maladjustment 
than could be found in the normal high school 
population, 56 cases from another Ohio city 
were obtained—all the adolescents of this 
group having been referred to a school psy- 
chological clinic for problem behavior. 


For further knowledge about the individ- 
uals of the regular High School A sample, 
a sociometric test was given at the same time 
the ISB was administered. On this sociometric 
blank each pupil was asked to list three names 
for each of the four following questions: 


a. The persons I would most like to be with at a 
party. 
b. The happiest girls or boys I know. 


c. The person I would select or vote for as a 
class representative. 
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d. The boys or girls whom I know that seem to 
be most unhappy. 


In addition to information obtained from an 
analysis of the sociometrics of the criterion 
group, a sample of cases was interviewed in a 
clinical interview lasting approximately one 
half hour. Interviewers had no knowledge of 
the ISB or sociometric results. The teachers of 
these same cases were also interviewed, both 
interviews covering all areas of adjustment as 
far as possible. Outlines of the interviews with 
the teachers and students are given below: 


Outline of Interview with Teachers 
Social: 
A. Relationship to other students 
B. Activities 
C. Leadership ability 
D. Relationship to teachers 
Schoo! : 
A. Kind of student — grades 
B. Any difficulties with school activities 
Family: 
A. Relationship to parents 
B. Relationship to siblings 
The above interview with the teachers gave the 
interviewer material to rate the student. The teach- 
ers’ ratings were not accepted verbatim but were 
rated by the interviewer in light of what was 
known of the teachers’ biases, etc. 


Outline of Interview with Students 
Educational and Vocational: 
A. Feelings about school 
B. Grades 
1. Favorite subjects 
2. Disliked subjects 
C. Plans for future work and postgraduate 
plans 
1. Work experiences already had 
Social : 
A. Activities participated in in school 
B. Close friends 
C. Problems of getting acquainted in school 
D. Dating 
1. How feel about it—going steady? 
2. How often date 
3. What do on a date 
E. Reactions to cliques 
F. Marital plans 


Family: 
A. Characterization of father and mother 
B. Relationship with siblings 
C. What does family do as a group 
D. Parental restrictions and discipline 
Miscellaneous: 
A. Happiest time can remember 
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B. Unhappiest time 

C. Three wishes 

D. Problems of adolescence 
E. Health 


The interviews were judged on a five-point 
scale for the areas of educational-vocational, 
social, family, and total adjustment. The total 
or over-all adjustment rating was not the sum 
or mean of the three areas but rather a clinical 
judgment of the total interview. 

Interviewing was done by three females who 
took notes on their interviews and worked 
from these notes. Ratings of each other’s cases 
were made independently so that it was pos- 
sible to obtain the reliability of the interview. 


The sociometrics were scored by giving the 
weight of +2 for any first nominations on the 
questions a, 6, and c, and a weight of 1 for 
any second or third nomination of these same 
questions. A weight of —6 was given for a 
first nomination of the only negative question, 
d, and a weight of —3 for a second or third 
nomination of the same question. 


Tentative manuals with sample statements 
for each item were then devised separately for 
boys and girls from the criterion population 
which included subjects on whom there were 
extensive interview materials plus sociometrics, 
subjects on whom there were sociometrics only, 
and subjects from a different population who 
were actual referents to a psychological clinic 
and for whom there was case history material 
available. Io determine whether or not the 
scoring samples were adequate for another pop- 
ulation, the manuals were then tested on a 
small population taken from a class of a high 
school (High School B) of lower socioecon- 
omic level in another city. Sources of the cri- 
terion group are summarized in Table 1. 











Table 1 
Sources of Cases for the Criterion Group 
Source Boys’ Girls 
High School A 
ISB, interview, and sociometric 29 31 
ISB and sociometric only 50 48 
Clinical cases from school 
psychological clinic 38 18 
High School B, ISB only 17 10 
All cases 134 107 
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A general conception of the classification of 
sample responses can be obtained from an anal- 
ysis of some typical kinds of conflict, neutral, 
and positive completions. Conflict responses 
were characterized by expression of social, 
sexual, physical, or intelligent inadequacy, 
overattachment, overconcern about or extreme 
hostility toward parents, expression of neurotic 
symptoms, social withdrawal, concern with 
moral standards, etc. Healthy or positive re- 
sponses were characterized by expression of 
self-acceptance, social adequacy, indication of 
wide interests, humor, participation in social 
activities, etc.; and neutral completions were 
characterized by clichés, stereotypes, factual 
statements, responses which were given with 
equal frequency by adjusted and maladjusted, 
etc. In some instances, special differential scores 
had to be made for different grade levels. For 
example, the response, “I have never danced,” 
to the stem, “Dancing .. .”’ in the boys’ manual 
is scored as neutral for ninth and tenth graders 
but as an indication of mild social conflict for 
eleventh and twelfth graders. An example of 
scoring samples for one item for boys and girls 
is given below: 


Boys 
35. My father... 
Score 


6 Conflict, is where I know not; I don’t care too 
much about him; is a person I don't 
like too well; is very harsh. 

5 Conflict, is a very sick man; nags me; is very 
strict; and I can’t get along very well 
sometimes; is hard to understand; is 
generally too busy to help me; did 
too much for me—1l wish I had done 
more for him. 

4 Conflict, isn’t very well; lives in... (another 
place) ; got me a bike for Christmas 
two years ago; got me a new suit; 
gives me what I want; is nice to me; 
is very kind; is very good to me; is 
too good to me. 


3 Neutral is dead; works hard; is a... (oc- 
cupation); works at . (specific 
company) ; is at work; works to sup- 
port us; has a lot of money; is going 
to be a little late tonight; is letting 
me use the car occasionally; says that 
I can’t have a car till I’m through 
college; is .. . (age); is a man. 
2 Positive, is good; is a good and honest man; 
is a good . . . (occupation) ; is a good 
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ball player; is a great man; is a very 
important person; is a foreman at 
his company; is very smart; helps me 
with my homework when I need help; 
and I are very much alike; is the one 
I copy after; is the best friend I’ve 
got; is the greatest guy ever to live. 

1 Positive, is a nice guy; is a fine man; is a 
wonderful man; is a real father; is a 
good sport and I love him too; is a 
person I think a lot of; is the most 
understanding father I know; and I 
like to do things together; and I get 
along very well together. 

0 Positive, is a good-natured character; is a 
great guy; is the best; is one of the 
best; is a swell companion; is an o.k. 
guy. 


Girls 
35. My father... 
Score 


6 Conflict, doesn’t understand me; is very mean; 
gets so mad at me; doesn’t seem to 
have his mind on anything but drink- 
ing. 

5 Conflict, is very sick; is deaf and it hurts me 
as well as it does him; is always 
fussing about something; is old and 
can’t understand certain things; is 
very old-fashioned; thinks I am very 
foolish and I guess he is right; is a 
good man but is hard on me; hasn’t 
a strong will; was the best friend I 
ever had. 


4 Conflict, is hard to talk to; is usually busy and 
I don’t see him as much as I would 
like; works in another city; has been 
dead for nearly 11 years; is good to 
me sometimes; is a swell guy but he 
doesn’t like my boy friend. 

3 Neutral is a... (occupation); works at... 

(company); works hard; is dead 

(no feeling expressed) ; smokes some- 

times. 

2 Positive, is good to me; is a good man; is a 
good, hard-working man; is a good 
auxiliary teacher in algebra; is very 
considerate and loyal to his family; 
is understanding; is very kind; is 
very dear to me; is wonderful al- 
though my own father died many 
years ago; is the most wonderful man 
in the world. 


1 Positive, and mother are nice; is nice; is a 
great help; teacher and friend; is a 
very fine person; is a wonderful man; 
is a good friend; is a good compan- 
ion; has a good sense of humor. 
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0 Positive, is very understanding and leaves most 
decisions up to me; is a wonderful 
man who thinks as I do; is the best 
Dad there is; is the best guy there is; 
is a swell guy; is a swell father; is a 
wonderful pal; is a good Joe; and I 
have lots of fun together; is one of 
the happiest persons I know. 


Test Reliability 


For a test of this type, where the items are 
not equivalent, it is difficult to assess internal 
consistency. An estimate, however, might be 
made by setting up roughly equivalent halves. 
For this purpose an odd-even reliability esti- 
mate was made using 50 randomly selected 
male and 50 female cases. On such a basis, re- 
liability for the boys’ manual was .74 and for 
the girls’ manual, .86 (corrected by the Spear- 
man-Brown prophecy formula). This reliabil- 
ity gives a minimal estimate since odd-even 
halves are not truly matched halves. 


Of greater significance was the interscorer 
reliability which provides a measure of the de- 
gree to which similar total scores could be ar- 
rived at by different raters working with the 
manuals. Interscorer reliability was obtained 
by having the two junior authors score 50 
female and 50 male cases which had been ran- 
domly selected. The interscorer reliability ar- 
rived at in this fashion for the boys’ manual 
was .96 and for the girls’ manual was .97. 


These reliability estimates compare well 
with similar reliabilities for the manual for 
the College Form. Split-half reliabilities for 
the College Form were .83 for the female 
manual and .84 for the male manual. Inter- 
scorer reliability with two trained scorers for 
the female manual was .96 and .91 for the 
male manual. 


Test Validity 


Three different measures of test validity 
were obtained. One of these consisted of com- 
paring ISB scores to the ratings of adjustment 
made by examiners following interviews simi- 
lar to the interviews given to the criterion 
group. Unfortunately, the interviews were col- 
lected slowly over a long period of time. Many 
interviews were collected more than a year 
after the tests had been given and, considering 
the instability of conflicts and tensions during 
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this period, they could not be expected to cor- 
relate too highly with tests given at a much 
earlier date. A second measure was obtained 
by correlating the scores from sociometrics giv- 
en at the same time as the tests with the ISB 
score of the same random sample of one-half 
of the high school population. 


Estimates of validity obtained from the 
above two tests are essentially attempts to as- 
sess screening value within a relatively normal 
population which would include comparatively 
few cases of serious maladjustment or disturb- 
ance. In other words, they measure only the 
screening value of the instrument within a 
population which at least did not include many 
of the kinds of problems which might be as- 
sociated with marginal economic level. The 
community might well be characterized as a 
child-centered one. Consequently, a third test 
of validity was made by collecting additional 
samples of clearly maladjusted children from 
three sources in the Columbus area. In these 
cases the subjects were all above 12 years of 
age, had 1Q’s of 80 or above, were white, and 
were referred to psychological clinics for rela- 
tively serious disturbances. Subjects drawn 
from The Ohio State University Psychological 
Clinic and the Children’s Mental Health 
Center tended to be predominantly cases from 
the middle class with serious adjustment diffi- 
culties. The cases from the Ohio Bureau for 
Juvenile Research tended to be boys and girls 
from socially deprived families with a most 
frequent complaint of delinquency. Mean 
scores for these groups were then compared to a 
random sample of cases from the cross-valida- 
tion, normal, high school group. The source, 
number, and sex of all validation subjects are 
given in Table 2. 











Table 2 
Sources of Cases for Cross-Validation Sample 
Source Boys Girls 
High School A 
ISB, sociometric, and interview 45 48 
ISB and Sociometric only 23 22 
Cases referred to psychological 
clinics 
Bureau for Juvenile Research 37 20 
Children’s Mental Health Center 45 11 
Ohio State University Psychol- 
ogical Clinic 3 2 
All cases 153 103 
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Results 


For the first test of validity, that of com- 
paring interview ratings with ISB scores for 
the 45 subjects on whom interview material 
was available, a Pearsoi:ian correlation of .20 
(SE = .14) was found for the boys’ manual. 
For the girls’ manual the correlation between 
the ISB scores and the interview ratings for 
48 girls was .37 (SE = .12). Sociometric 
scores for 68 boys were obtained and the cor- 
relation with the ISB again was .20 (SE = 
.12).1 For 70 girls the correlation was .32 
(SE =.11). 

Owing to the relatively narrow range of in- 
terview ratings, biserial correlations were cal- 
culated at a cutting score of an average rating 
of 3.0. The biserial correlation for boys was 
.20, and for girls, .58. For the subjects who 
had both sociometric and interview, these two 
measures yielded Pearsonian intercorrelations 


of .66 for the 45 boys and .49 for the 48 girls. 


Distributions of scores for the selected mal- 
adjusted subjects as compared with a random 
selection from the normal high school popula- 
tion is given in Table 3 for 55 boys and in 
Table 4 for 33 girls. The mean differences be- 
tween the groups were highly significant. A 
cutting score of 135 would correctly identify 
78% of the unselected normals and 65% of 
the maladjusted cases for the boys, and for the 
girls it would correctly identify 85% of the 
unselected normals and 85% of the malad- 
justed. 


It appears that both the sociometric scores 
and the adjustment ratings which were based 
on the interview and analysis of teacher judg- 
ments tend to correlate more highly than the 
ISB with either of these. It seems likely that 
both the adjustment ratings and the sociomet- 
ric scores tend to be biased in terms of objec- 
tive evidences of accomplishment, while the 
ISB assesses primarily the subject’s perceptions 
of his adequacy and potential satisfactions. 

This difficulty of assessing the individual’s 
perception of adequacy as opposed to objective 
achievement appears to have been greater for 


1When scores from two tests agree in the direc- 
tion of maladjustment, the correlation is reported as 
positive although on the ISB a high score indicates 
maladjustment, whereas on the sociometric test a 
high score is indicative of good adjustment. 
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Table 3 
ISB Scores of 55 Boys Referred to Psycho- 
logical Clinics and 55 Boys Randomly 
Selected from a High School (A) 
Population 








Score Normal Maladjusted 





190-194 1 
185-189 

180-184 1 
175-179 1 
170-174 
165-169 
160-164 
155-159 
150-154 
145-149 
140-144 
135-139 
130-134 
125-129 
120-124 
115-119 
110-114 
105-109 
100-104 
95-99 
90-94 
85-89 
80-84 1 
75-79 

70-74 1 


N 55 55 
Mean* 120.9 141.0 
SD 17.7 18.8 
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* Probability of chance difference in means <.001. 


the boys than the girls and is reflected in the 
discrepant efficiency of the two manuals. There 
were several boys who expressed considerable 
self-doubt and insecurity on the ISB but re- 
ceived high sociometric ratings and high inter- 
view ratings. It appears that many of these 
cases are characterized by extreme striving 
and, although given high sociometric ratings 
because they have successfully competed for 
class offices, athletic teams, etc., they, them- 
selves, are still operating under the feelings of 
inadequacy with regard to their own high 
goals. In retrospect it also appears that boys 
tended to cover up felt inadequacies in the in- 
terview situation more than did the girls, pos- 
sibly because only female interviewers were 
used. A further point to be considered is that 
social adjustment of boys was a little more 
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Table 4 


ISB Scores of 33 Girls Referred to Psy- 
chological Clines and 33 Girls Randomly 
Selected from a High School (A) Population 








Score Normal 


Maladjusted 





185-189 1 
180-184 1 
175-179 

170-174 

165-169 

160-164 

155-159 

150-154 1 
145-149 
140-144 
135-139 
130-134 
125-129 
120-124 
115-119 
110-114 
105-109 
100-104 
95-99 
90-94 
85-89 
80-84 1 
75-79 3 


Noe An SS Ww Ww w 
NF KH NYU AD Ve | et 


— 





N 33 33 
Mean* 116.9 149.3 
SD 21.8 1°.2 





* Probability of chance difference in means <.001. 


dificult to assess since the girls had a more 
hierarchical clique organization. Membership 
in one of the girls’ cliques was more clearly de- 
fined and appeared to be a relatively accurate 
criterion of social adjustment. 


Comparison of the effectiveness of the two 
manuals for the maladjusted clinic cases is not 
feasible since there is no way of equating the 
two groups for degree of maladjustment. 

The results with this first test of the validi- 
ty of the ISB for high school students may be 
termed promising. However, as with other at- 
tempts to assess the adjustment of adolescents, 
such as those made by Cox and Sargent [2] 
and Symonds [8], we have encountered the 
same problem of finding it difficult to discrim- 
inate the individuals whose test responses seem 
to indicate considerable disturbance and yet 
are not easily discriminable from other boys 
and girls in terms of their behavior. The con- 
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cept of maladjustment in an adolescent popula- 
tion is still one which requires considerable in- 
vestigation, probably of longitudinal nature, 
before sensitive tests may be devised to select 
maladjusted individuals in a presumably nor- 
mal population. 


Summary 


Boys’ and girls’ manuals for the objective 
scoring of the ISB for high school adolescents 
were devised based on an analysis of selected 
cases and an analysis of approximately half of 
the population of a small high school. 


The following conclusions regarding a pre- 
liminary evaluation of the reliability and valid- 
ity of the manuals seem warranted: (a) Inter- 
scorer reliability for trained scorers was high, 
-96 for the boys’ manual and .97 for the girls’ 
manual. Split-half reliabilities, although giving 
a minimal estimate of internal consistencies be- 
cause of nonequivalence of halves were .74 for 
the boys’ manual and .86 for the girls’ manual. 
(5) Low positive correlations, statistically sig- 
nificant only in the case of the girls’ manual, 
were obtained in comparing the ISB scores 
with interview ratings made by psychologists 
and with sociometric data within an essentially 
normal population. (c) The boys’ and girls’ 
manuals discriminate with high efficiency be- 
tween selected groups of maladjusted children 
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referred to clinics and a random selection of 
high school children of a presumably normal 
population. 


Received June 10, 1953. 
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A Note on the Welsh MMPI Anxiety Index’ 


Eugene E. Levitt 
Child Welfare Research Station 
State University of Iowa 


A formula for the measurement of anxiety 
based on MMPI scores has been proposed by 
Welsh [3]. In its simplest form, the index is: 
1.33D + 1.00Pt — .66Hs — .66Hy. 

According to Welsh, the index derives from 
a classical anxiety neurotic pattern in which 
the depression scale score predominates. It is 
pertinent to ask whether this index will meas- 
ure with reasonable accuracy in cases in which 
anxiety is not the major symptom. Welsh [3] 
offers data from four other sources in which 
the index score appears to correspond to diag- 
nostic categories other than anxiety states. 
However, the sources quoted by Welsh show 
considerable differences among themselves. 
Gough’s data [1] have the “severe” neurotics 
25 Al points above the psychotics, while 
Schmidt’s [2] have the neurotics higher by 11 
points. Differences between sources for four 
diagnostic categories average over 13 AI points. 

To test the efficacy of the AI, clinical judg- 
ments of degree of anxiety were made on 23 
patients by a psychiatrist and a psychologist? 


1 An extended report of this study may be ob- 
tained without charge from Eugene E. Levitt, Child 
Welfare Research Station, University of Iowa, Iowa 
City, Iowa, or for a fee from the American Docu- 
mentation Institute. To obtain it from the latter 
source, order Document No, 4196 from ADI Auxili- 
ary Publications Project, Photoduplication Service, 
Library of Congress, Washington 25, D. C., remit- 
ting in advance $1.25 for microfilm or $1.25 for 
photocopies. Make checks payable to Chief, Photo- 
duplication Service, Library of Congress. 


2I am indebted to Maurice D. Friedman, M. D., 
who was the psychiatrist; the author was the psy- 
chologist. 


following one to three hours of intensive in- 
terview. Correlation between judgments was 
.88. None of the patients was diagnosed as hav- 
ing anxiety as a primary symptom. According 
to the eventual diagnoses of the psychiatrist, 
the group was made up of six nonpsychotic 
depressives, five psychopaths, three schizophren- 
ics, two homosexuals, one normal, and three 
cases with unclassified or mixed neuroses. 
Three cases were undiagnosed. 

The mean clinical judgment, on a 10-point 
scale, was 4.17, with a sigma of 2.25. The 
mean AI score was 78.67, with a sigma of 
29.38. 

The product-moment correlation between 
the two sets of scores was .28 (.41 would be 
significant at the .05 level). A corresponding 
rank-order correlation was .23. 

The absence of relationship indicates that 
the AI will probably not give a reliable esti- 
mate of degree of anxiety in cases without the 
anxiety pattern. The AI should be used cau- 
tiously, if at all, until it has been subjected to 
much further investigation. 


Brief Report 
Received January 25, 1954. 
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Motivational Variables in the Assuming 
of Combat Obligation’ 


Lee B. Sechrest and John K. Hemphill 


Personnel Research Board, The Ohio State University 


The purpose of this paper is to compare and 
interpret the differences which appear between 
the responses to the stems of Rotter’s Incom- 
plete Sentences Blank of (a) a sample of air- 
crew members who proceeded directly into 
combat after combat crew training, and (4) a 
sample of aircrew members who, although 
having an equal opportunity to go into combat, 
did not do so. Such a comparison may reveal 
underlying motivational patterns predictive of 
tendencies to avoid stress situations. ‘he iden- 
tification of such patterns would have direct 
significance for the applied problem of aircrew 
member selection as well as for fundamental 
problems in predicting personal reactions to 
impending stress. 


The practical implication of this investiga- 
tion for the Air Force merits further amplifi- 
cation. The training of aircrew members for 
combat duty is extremely expensive. When 
one or more members of a crew do not go into 
combat with the crew with which they are 
trained, crew integrity is impaired and the jus- 
tification for crew training is thereby vitiated. 
Insofar as crew training beyond individual 
specialty training can be justified, it becomes 
more important that the initial selection of 
crew members be done in such a manner as will 


1Based on a paper presented at the 1953 meeting 
of the American Psychological Association. The re- 
search was conducted under a contract between The 
Ohio State University Research Foundation and the 
Human Factors Operations Research Laboratories 
(HFORL), Department of the Air Force. The data 
were collected in Japan and Okinawa by Lt. Col. 
Fred E. Holdrege and the junior author as repre- 
sentatives of HFORL. The authors wish to express 
appreciation to Mr. Luigi Petrullo, Chief, Person- 
nel Research Directorate, HFORL, who initiated 
plans for the study of these crews. Interpretations 
and opinions expressed here are those of the authors 
and should not be regarded as having the endorse- 
ment of the Air Force. 
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maximize the probability that an individual 
will remain with his crew throughout the an- 
ticipated tour of combat duty. Procedures to 
reduce the number of trained crew members 
who fail to fulfill their combat assignments 
would result in economies beyond the reduction 
of the cost of training those individuals who do 
not meet combat obligations. 

From the point of view of personality dy- 
namics, observations made with respect to reac- 
tion to stress situations are of prime impor- 
tance. The comparison made here provides 
some cues concerning the motivational and per- 
sonality variables which are related to reac- 
tions to an impending stress situation. Consid- 
erable information is availab)< in the psycho- 
logical literature concerning reactions of per- 
sons in stress situations and concerning the 
personality patterns of individuals who sur- 
vive or break down under extreme stress. No 
attempt will be made here to review this liter- 
ature because of the recent excellent review by 
Holtzman and Bitterman [3]. Much less is 
known concerning the motivation patterns 
which may be responsible for a given individu- 
al’s either (a) accepting exposure to a situa- 
tion known to involve high stress, or (+) 
avoiding such situations by either socially ac- 
ceptable or socially unacceptable means. 


Procedure 


Collection of data and the sample. The 
Rotter Incomplete Sentences Blank was ad- 
ministered to 346 aircrew members at the time 
they were undergoing combat crew training. 
Their ages ranged from eighteen to forty years 
and many were married and had families. 
These crew members included both recalled re- 
serves and regular Air Force personnel. They 
were being trained for immediate combat duty 
in the Far East Air Force. After these crews 
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had completed their combat training, they 
were sent to Air Force bases on the West 
Coast to await overseas assignments and to ac- 
quire further training. The crews remained at 
these bases for a period of approximately two 
months before they were shipped to their com- 
bat assignments. During this period, 63 of the 
crew members for one reason or another were 
replaced on their crews and did not go with 
their crews into the combat assignment. A fol- 
low-up survey, made a few weeks after the 
crews had gone into combat, disclosed the fol- 
lowing reasons for the failure of some of the 
crew members to go overseas: 


1. Superior or special ability which made it de- 
sirable, from the point of view of the Air Force 
total mission, to reassign them. 


2. Physical disabilities or complaints which had 
not been revealed during training. 

3. Requests for removal from flying status for 
reasons of “fear of flying.” 


4. Requests for release from combat assignments 
because of unusual personal hardship. 


Only six of the 63 were not given overseas 
assignments because of special abilities and 
these six were eliminated from the sample for 
the comparisons which were made. The se- 
lected samples consisted of (a) 283 crew mem- 
bers who went overseas in accord with prior 
plans (the overseas group), and (4) 57 crew 
members who did not do so because of reasons 
of physical complaints, personal hardships, or 
“fear of flying” (the nonoverseas group). 

The Rotter Incomplete Sentences Blank 
and scoring categories. The Rotter Incom- 
plete Sentences Blank consists of a series of 
forty short sentence fragments, such as “J 
like . . .”; “What annoys me sot Sage? | 
mother . . .”; etc. These sentence fragments 
are referred to as “stems,” and it is the sub- 
ject’s task to extend each stem into a complete 
sentence. That portion of the sentence which 
the subject supplies is called the “completion.” 
Thus the stem “J like . . . .” may be extended 
by the completion “reading in bed” to form 
the complete sentence, “J like reading in bed.” 

Rotter and Rafferty [4] have published a 
manual for scoring completions made by col- 
lege students. In a previous study [2], this 
scoring manual was found to be inadequate for 
the purpose of scoring completions supplied by 
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aircrew personnel. A new scoring system was 
devised to evaluate the content of completions 
provided by aircrew members. The Air Force 
scoring manual [2] was established in terms of 
content principles or categories which differen- 
tiated crew members in respect to a sociometric 
criterion of “crew adjustment.” After a pre- 
liminary examination of a large sample of re- 
sponses, the content categories from the Air 
Force manual were utilized to establish the 
following a priori scales: 


1. Social Responsibility—the degree to which an 
individual’s responses indicate that there are duties 
which men are obligated to perform, that there are 
acts or services which men should perform in order 
for society to function optimally, and the degree to 
which an individual’s responses demonstrate aware- 
ness of and concern for the rights and welfare of 
his fellow men. 


Typical completions: “Men should respect the 
rights of others’; “A mother should do the best that 
she can for her children”; “Other people have feel- 
ings besides yourself”; “What pains me is when I 
hurt someone.” 


2. Education or Training—the degree to which an 
individual’s responses indicate that education, know- 
ledge, or training of either a specific or a general 
nature is desirable. 

Typical completions: “J want to know more about 
my job”; “I regret that I didn’t finish college”; “I 
need more training’; “In school I enjoy learning.” 

3. Financial—the degree to which an individual’s 
responses are concerned with financial affairs, and 
his ability to meet his financial obligations. 

Typical completions: “J need money”; “My great- 
est worry is financial”; “J suffer from an empty 
purse”; “I regret to be broke.” 

4. Physical Comfort—the degree to which an in- 
dividual’s responses imply a concern with the grati- 
fication of physical desires. 

Typical completions: “J like eating and sleeping” ; 
“At bedtime 1 want to sleep”; “I need some food 
and sleep”; “I am best when I have a good meal 
and a few drinks.” 


5. Family Separation—the degree to which an in- 
dividual’s responses express regret or concern over 
being away from his wife and/or family. 

Typical completions: “J like to be with my fami- 
ly”; “The best place is with your wife’; “I can't 
be happy away from my wife”; “I am best when 
I’m playing with my kids.” 

6. World Affairs—the degree to which an indi- 
vidual’s completions are indicative of concern with 
national and international conditions. 


Typical completions: “J want to know what this 
world is coming to”; “What annoys me is the state 
of the union and the mining business”; “J feel per- 
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turbed at the present world situation”; “J hate to 
see so much corrupt government.” 


7. Somatic Complaints — the degree to which an 
individual’s responses imply concern or preoccupa- 
tion with physical health and condition. 

Typical completions: “My merves are shot”; “I 
suffer from sinus trouble”; “I need more pep”; 
“Sometimes 1 have fear of cancer.” 


8. General Air Force Satisfaction—the degree to 
which an individual’s completions indicate that he 
wants or intends to remain in the Air Force, or that 
he is generally satisfied with service in the Air 
Force. 

Typical completions: “J like the Air Force’; “J 
regret that I didn’t stay in service after last war’; 
“IT can’t see being in the Air Force”; “I need out 
of service.” 


9. Specific Air Force Satisfaction—the degree to 
which an individual’s completions indicate that he 
is favorably disposed toward the military routine, 
i.e., the everyday activities, events, and regulations 
of the Air Force and the treatment accorded him by 
the Air Force. 


Typical completions: “This place is fine for an 
Air Base and living conditions”; “J feel that the 
crew I am on is a very good crew”; “I hate to 
stand in line”; “I regret ever having transferred 
to SAC.” 


40. Personal Adequacy—the degree to which it 
may be inferred from an individual’s completions 
that he is concerned with his adequacy and ability 
to perform his role in society. 


Typical completions: “I regret not having a more 
complete personality’; “What annoys me is fail- 
ure”; “My greatest fear is that I'll fail as someone’s 
idol.” 

11. Familial Solicitude—the degree to which an 
individual’s completions express concern over or 
solicitude for the welfare of his family. 


Typical completions: “A mother should be taken 
care of”; “My greatest fear is in knowing my family 
is in danger”; “My greatest worry my parents 
health”; “My greatest worry security for my fami- 
ly.” 

12. Sexual—the degree to which an individual’s 
responses are indicative of concern or preoccupa- 
tion with heterosexual relationships other than 
marital, 


Typical completions: “What annoys me are wo- 
men who play hard to get”; “I need some loving” ; 
“I secretly love sex” ; “Most women are easy to get.” 

13. Interpersonal Relations—the degree to which 
an individual’s responses indicate that interpersonal 
relationships were or are of a satisfactory or pleas- 
ant nature. 

Typical completions: “Back home are many 
friendships I miss”; “People are nice to have 
around”; “Other people get on my nerves some- 
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times”; “The only trouble is a few people irk me.” 

14. Home—the degree to which an individual's 
completions express concern with or dislike of being 
away from home. 

Typical completions: “Back home is where I don’t 
particularly want to go”; “I regret being away from 
home so much”; “The happiest time will be when 
I get home”; “I wish I could get home soon.” 

15. Achievement—the degree to which it may be 
inferred from an individual’s completions that he is 
concerned with achievement. 

Typical completions: “I like to make Tech. Sgt.” ; 
“In school I hate to waste time and can never 
learn enough”; “I secretly want to make a success” ; 
“I hope to some day be as big a success as my 
father.” 

16. Optimism—the degree to which an individ- 
ual’s responses reflect his propensity to look at the 
“bright side” of events. 

Typical completions: “The best is yet to come”; 
“I feel that some day I shall attain the things I de- 
sire’; “The future holds nothing’; “The 
trouble is that things never come off as planned.” 


only 


Three independent judges assisted in the es- 
tablishment of these sixteen scoring scales by 
judging the relevance to each scale of the con- 
tent categories defined in the Air Force man- 
ual [2]. Only those categories on which all 
three judges agreed as to their scale relevance 
were included in the computation of scale 
scores. The number of stems which were 
scored for each scale ranged from 3 to 17. An 
individual’s score on a given scale was the sum 
of weights assigned to his completions of those 
stems which were scored. Completions about 
which the judges agreed that they indicated a 
high degree of the characteristics defined by 
any given scale were assigned a weight of two. 
A completion which indicated a low degree of 
the characteristics received a weight of zero. 
All other completions given to the stem were 
scored one. 


Results 


Table 1 presents (a) the number of stems 
scored, (4) the mean, and (c) the standard de- 
viations of the scale scores for the total sample 
of 340 crew members. 

The scale scores of the sample of 283 air- 
crew members who proceeded directly into 
combat were compared with the scale scores of 
the sample of 57 crew members who did not go 
into combat by computation of a ¢ test of the 
difference between the sample means. Table 2 
presents this analysis. 
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Table 1 


Number of Stems Scored and Means and Standard 
Deviations of Sixteen Scale Scores for the 
Completions Provided by 340 Aircrew 
Members to The Rotter Incomplete 
Sentences Blank 








Number of 
Scale stems Standard 
scored Mean deviation 





1 Social Responsibility 4.39 60 
2 Education or Training 5 5.44 67 
3 Financial 6 6.38 64 
4 Physical Comfort 5 5.38 57 
5 Family Separation 7 18.30 1.60 
6 World Affairs 15 15.68 1.18 
7 Somatic Complaints 6 6.37 87 
8 General AF Satisfaction 14 13.50 1.59 
9 Specific AF Satisfaction 13 11.80 1.59 
10 Personal Adequacy 15 15.47 1.04 
11 Familial Solicitude 3 3.46 67 
12 Sexual 9 9.40 69 
13 Interpersonal Relations 17 17.54 1.91 
14 Home 14 14.94 1.28 
15 Achievement 10 10.55 .74 
16 Optimism 11 10.84 1.44 





The difference between the means of the two 
samples of crew members is significant at the 
.01 level of confidence for three scales and at 
the .05 level for an additional one. The over- 
seas group made completions to more stems in- 
dicative of (a) desires for more education or 
training, (4) less somatic complaints, and (c) 
more feelings of social responsibility. They al- 
so tended to respond with more completions 
indicating general satisfaction with the Air 
Force. 


Dis:ussion 

It is necessary to rake specific at the outset 
two major assumptio#: upon which the follow- 
ing discussion of res®''s is based. First, we as- 
sumed that the conkpetions provided by the 
crew members could::ve treated as valid evi- 
dence of their attitudes and motives. It is rec- 
ognized that this assumption involves the pos- 
sibility that some crew members may disguise 
or otherwise fail to reveal their “true feelings.” 
This possible shortcoming may not be as great 
in interpreting group differences as in inter- 
preting individual responses, if we assume that 
most individuals usually will respond in a 
straightforward manner. Second, we assumed 





Table 2 


Mean Scale Scores of a Sample of 283 Overseas 
Crew Members and 57 Nonoverseas Crew Members, 
the Differences between the Mean, and the ¢ 
Value of the Differencet 








Mean Mean non- 
Scale overseas overseas 
group group Diff. ¢ 





1 Social 

Responsibility 4.42 4.22 20 2.67** 
2 Education or 

Training 5.49 5.19 30 4.27** 
3 Financial 6.34 6.54 —.20 1.85 
4 Physical Comfort 5.38 5.36 . 
5 Family 

Separation 18.32 18.15 Sy a 
6 World Affairs 15.66 15.75 —.09 .51 
7 Somatic 

Complaints 6.31 6.68 —.38 2.73%* 
8 General AF 

Satisfaction 13.60 13.02 58 2.13* 
9 Specific AF 

Satisfaction 11.83 11.63 20 8.95 
10 Personal 

Adequacy 15.46 15.51 —.05 .31 
11 Familial 

Solicitude 3.48 3.37 -11 1.20 
12 Sexual 9.38 9.49 —11 1,11 
13 Interpersonal 

Relations 17.55 17.46 09 .37 
14 Home 14.91 15.05 —.14 .66 
15 Achievement 10.57 10.42 15 1.74 
16 Optimism 10.91 10.49 42 1.96 





+ An F test revealed that variances on several of the 
scales were not homogeneous for the two groups. Fur- 
thermore, the sample sizes for the two groups are con- 
siderably different. Therefore, a procedure given by Ed- 
wards [1] to correct simultaneously for unequal N’s and 
heterogeneous variances was used. 


* Significant at .05 level of confidence. 
** Significant at .01 level of confidence. 


that for each of our relatively crude scales a 
higher scale score is indicative of stronger or 
more intense attitude. Frequency of response 
has been questioned as a satisfactory indicator 
of the intensity or importance of an attitude. 
Some of the usual objections to this assumption 
may be irrelevant because the response fre- 
quency with which we are concerned is of 
“freely” given responses rather than a selection 
from alternatives suggested by the investigator. 


One of the differences between the group of 


— > 
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individuals who went overseas as contrasted 
with those who did not is to be found in their 
expression of general satisfaction with their 
present position. The members of the overseas 
group express greater satisfaction with the Air 
Force, especially in respect to its general char- 
acteristics (Item 8, Table 2). There is little 
evidence that members of the overseas group 
find some of the deprivation associated with 
combat crew membership less severe. They ex- 
press about as much concern with being away 
from home and with being separated from 
their families (Items 5 and 14, Table 2). 
There is no evidence that the two groups differ 
in the extent to which they value physical com- 
fort (Item 4, Table 2). Thus we cannot ex- 
plain the greater satisfaction of the overseas 
group in terms of their being less sensitive to 
the common undesirable aspects of combat 
crew duty. 


A second difference between the two groups 
appears in the manner in which they regard the 
potential values of extended education and 
training. The members of the overseas group 
express a greater desire for further training 
and education, both military and civilian (Item 
2, Table 2). Apparently this desire for know- 
ledge operates independently of the individual’s 
satisfaction or dissatisfaction with his Air Force 
career. We feel that the difference between the 
two groups may be interpreted as indicating a 
greater willingness or ability on the part of 
the overseas group to defer immediate self-in- 
terests in favor of long-range satisfaction of 
less immediate goals. 


The two groups of crew members differ also 
in their attitudes toward social responsibility. 
The overseas crew members more frequently 
made completions which were indicative of 
social concern (Item 1, Table 2). This greater 
feeling of social responsibility does not appear 
to be due to greater awareness of international 
and world problems (Item 6, Table 2), but 
only of greater feeling of being called upon to 
do something about such problems. 


The members of the group who did not go 
overseas more frequently made completions 
which took the form of somatic complaints 
(Item 7, Table 2). We have no evidence 
about the way the two groups actually dif- 
fered in state of health and we assume that 


since each crew member had been given a care- 
ful physical examination before being assigned 
to crew duty there was no organic basis for the 
difference between the two groups. The dif- 
ference in somatic complaints between the two 
groups raises the question about a possible dif- 
ference in general mental health. The evidence 
available, however, does not suggest that the 
groups differ in terms of general indicators of 
personal maladjustment. There is no significant 
difference between the groups in the areas of 
feeling of personal adequacy (Item 10, Table 
2), satisfaction with interpersonal relation- 
ships (Item 13, Table 2), or sexual orientation 
(Item 12, Table 2). We prefer to interpret the 
greater frequency of somatic complaints which 
characterizes the nonoverseas group as a use of 
a socially accepted means of avoiding an un- 
pleasant situation. 


Summary and Conclusions 


The completions made to The Rotter Incom- 
plete Sentences Blank by two groups of air- 
crew members have been compared. A group 
of 283 men who went to an “overseas” com- 
bat assignment was found to differ from a 
group of 57 men who had the same opportunity 
but did not go overseas. The following pat- 
terns of attitudes or motives characterized the 
members of those crews which went overseas: 


1. General satisfaction with the Air Force 


2. More concern with opportunities for 
training and education 


3. Less frequent somatic complaints 
4. Feeling of general social responsibility 


The findings of this study are suggestive of 
a need for a more complete exploration of the 
personality variables which are associated with 
man’s social behavior when issues of great 
stress are involved. Patterns of attitudes may 
be delineated which are directly associated with 
the willingness to put social obligations or 
duty above immediate personal rewards. This 
study encourages attempts to develop person- 
nel procedures by which aircrew members may 
be selected in a manner to avoid economic 
wastes associated with the expensive training of 
individuals who have a high probability of 
avoiding stressful duty. 


Received June 9, 1953. 
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in Drawings of the Human \Figure 


Walter A. Woods and William E. Cook 


Richmond Professional Institute 


Widespread use of drawings of the human 
figure as a projective method in personality di- 
agnosis has raised many questions concerning 
the contributions of art training to the render- 
ing of the figure. 


Experience with those engaged in the study 
of drawing suggests that the placement of the 
arms and hands—body parts which are often 
regarded as indicative of basic personality 
structure (see, for example, Machover [3], 
Buck [1], Jolles [2])—is particularly related 
to proficiency in drawing. There are many in- 
dications that students tend to learn to draw 
the hands and feet only after they have ac- 
ceptably mastered the drawing of the other 
parts of the body. This tendency to leave the 
hands (and often the feet) to the last appears 
to be due largely to the fact that hands and 
feet are more difficult to draw. As the student 
improves in his ability to represent the re- 
mainder of the body, the ineptness in render- 
ing the hands becomes apparent to him; thus 
the student attempts to place the hands in 
such a position as to hide them. 

If this is true, then the position in which 
the hands (and thus the arms) are drawn is 
significantly structured by the level of attain- 
ment in drawing which the individual has 
reached. This study was planned to investigate 
the relationship between rendering of the hands 
and level of proficiency in drawing. 


Experimental Design 


House-Tree-Person (HTP) drawings of 
the represented person made by 138 eighth- 
grade students were used for the study. The 
rendering of the hands in each of the 138 
drawings was classified according to one of the 
following six methods of representation. 


1, Either or both arms are shown away from the 
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body. The arms are cut off at the wrists; no hands 
are shown. 

2. Either or both hands are shown without fingers 
or thumbs. 


3. Either or both hands are shown with thumb. 
Fingers are indicated but not clearly delineated. 


4. Thumb and four fingers are shown on either 
or both hands. 


5. Both hands are hidden behind the back. 
6. Hands are in pockets. 


After the drawings had been classified, they 
were submitted to raters who had no know- 
ledge of the purpose of the experiment nor of 
the classification on the basis of the drawn 
hands. One rater was a professional artist and 
head of a department of commercial art in an 
art school; the other “rater” consisted of a 
group of four M.A. candidates in clinical psy- 
chology, who were requested to arrive at a 
rating of the drawings by majority agreement, 
using a paired-comparison method. Both raters 
were asked to rate the drawings in terms of 
the proficiency of drawing of the human figure. 
Raters were requested to classify the drawings 
into three groups: those representing the up- 
per 27 per cent in proficiency, those repre- 
senting the lower 27 per cent in proficiency, 
and those in the middle 46 per cent. 

Degree of agreement between raters was de- 
termined by counting the number of drawings 
classed in each of the three groups by each 
rater and computing coefficients of contingency 
for (a) agreement in all nine categories, (+) 
agreement in the bottom 27 per cent compared 
with agreement in all others, and (c) agree- 
ment in the upper 27 per cent compared with 
agreement in all lower groups. 

Frequencies of occurrence of each of the six 
types of hand rendering were then determined 
for each of the three proficiency levels for 
each of the raters. Correlations between hand 
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rendering and levels of proficiency represented 
by upper and lower 27 per cent ratings were 
estimated from Flanagan’s tables [4, p. 345]. 


Results 


Table 1 summarizes the degree of agreement 
between judges. A y? of 111.0 (p < .01) from 
the nine cells produces a contingency coefh- 
cient (corrected for number of classes) of .23, 
indicating association in this amount between 
raters for the entire set of drawings. Table 1 
shows that there is agreement between raters 
in the extreme groups but that there is disagree- 
ment concerning the middle of the distribution. 
The nature of agreement in the extremes is 
demonstrated by the y? values of 19.0 (9 < 
.01) and 27.0 ( < .01), obtained for agree- 
ment in upper group vs. all others and for 
agreement in lower group vs. all others, re- 
spectively. Coefficients of .35 for association in 
the upper group and .41 for the lower group 
were determined. When corrected for number 
of classes, these became .49 for the upper group 
and .57 for the lower group; these values in- 
dicate satisfactory agreement between raters. 

Goodness of drawing in relation to type of 
hand rendering is summarized in Table 2. The 
percentages of drawings in which the hands 
are rendered according to each of the six clas- 
sifications are given for each of the raters for 
the upper and lower 27 per cent groups. 

The data support the hypothesis that place- 
ment of the hands in drawn representations of 
the human figure is a function of level of pro- 
ficiency in drawing. Those with lesser ability 
tend to draw the arms without hands, a sig- 
nificant relationship represented by a coefhi- 
cient of correlation of .30 or .27. In not less 
than 24 per cent of the drawings, subjects 
with greater ability place the hands behind the 


Table 1 


Comparison of Drawing Ratings: Number of 
Drawings in Each Group 








Classification Classification by artist 





by psychology Upper Middle Lower Total 
candidates 27% %6% 27% 

Upper 27% 22 46 2 37 
Middle 46% 12 37 15 64 
Lower 27% --- 3 14 20 37 
Total 37 64 37 138 








Walter A. Woods and William E. Cook 


back instead of trying to draw them at all. A 
product-moment correlation of .43 (art pro- 
fessional) or .45 (psychology candidates) dem- 
onstrates the extent of the relationship between 


level of proficiency and tendency to draw 
hands behind the back. 


Because of the effect of the unreliability of 
ratings of proficiency on the correlation be- 
tween proficiency and type of hand rendering, 
it appears desirable to ascertain also the degree 
of relationship for those drawings in which 
there was a 1.0 correlation between raters 
(complete agreement). Since the judgment as 
to placement of hands is entirely reliable and 
unequivocal, this relationship can best be de- 
termined by comparing only those drawings on 
which both raters agree as to belonging in the 
upper and lower 27 per cent groups. There 
are 42 such drawings—10 with hands behind 
the back (nine of which were placed in the up- 
per 27 per cent group and one of which was 
placed in the lower 27 per cent group by both 
raters) and 32 with hands unconcealed (11 
of which were placed by both raters in the up- 
per 27 per cent group and 21 of which were 
placed by both raters in the lower 27 per cent 
group). The ? of this distribution is 9.2 (p < 
.01). The contingency coefficient corrected 
for number of classes is .60, suggesting a ra- 
ther substantial association between proficiency 
in drawing and tendency to avoid drawing the 
hands. The technique just described is, of 
course, analogous to correction for attenua- 
tion. 


Relationship of other placements of the 
hands to Jevel of proficiency is less clearly in- 
dicated. Among those rated best by the pro- 
fessional artist there is less tendency to repre- 
sent the hand by a thumb and a vague pattern 
of indeterminate number of fingers; the tend- 
ency is reversed among those rated best by the 
psychology group. 

Among both the least and the most pro- 
ficient students there is a marked tendency to 
sketch in the hand without indicating either 
the thumb or fingers. This tendency might 
very well be expected in a group of eighth- 
grade students. 


The results are in agreement with observa- 
tions made by the senior author in numerous 
schools, in observing the development of ability 
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Table 2 
Percentages, in Upper and Lower 27% Groups, of Drawings Classified According to Type 
of Hand Rendering, and Correlations between Drawing Proficiency and 
Type of Hand Rendering 











Hand- Rated by artist Rated by psychology candidates 
rendering 

classifi- Upper Lower r Upper Lower r 

cation 27% 27% 27% 27% 
1 2.7 13.5 —.30** 0 5.4 —.27** 
2 27.0 35.1 —.N9 29.7 45.9 —.17* 
3 18.9 32.4 —.16 27.0 13.5 21° 
4 13.5 8.1 A$ 13.5 8.1 13 
5 29.7 5.4 43** 24.3 2.7 45°* 
6 8.1 5.4 10 54 2.7 .09 





oe Significant at .05 level. 
** Significant at .01 level. 


to draw the human figure at junior high, high 
school, or art school level. Once the student 
attains some mastery of the larger body masses 
and of the relatively simpler geometrical 
masses of the head, torso, arms, and legs, he 
becomes aware of his inability to represent 
the relatively more complex hands. 


The student (or the client) may, of course, 
ignore this difference in representativeness and 
the ineptness which it reveals, or he may choose, 
as many apparently do, to hide his lack of skill 
by placing the hands where their actual ren- 
dering is made unnecessary. The ignoring or 
obviating of the drawing of the hands tends to 
perpetuate itself, producing a stereotype draw- 
ing in which the hands are invariably placed 
out of view. 

The fact that many individuals do establish 
and perpetuate this stereotype presents a very 
real problem to those who use the drawn fig- 
ure in personality interpretation and diagnosis. 
The authors have no solution to offer in terms 
of what might be done to permit interpretation 
around this stereotype or others brought about 
largely by the influence of training. It seems 
desirable, however, to call attention to the re- 
lationship and to warn that personality in- 


terpretations from the drawn figure are haz- 
ardous unless specific knowledge as to the pro- 
ficiency of the client in drawing is available. 


Conclusions 


The manner of representation of the hands 
in the drawing of the human figure or person 
is a function of level of proficiency in drawing. 
Limitations in the interpretation of personality 
through drawn representations of the human 
figure are imposed by this relationship. 


Received June 22, 1953. 
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Prognostic studies quite consistently indi- 
cate a positive, though small, relationship be- 
tween judgments of the “affect” displayed by 
hospitalized mental patients and a favorable 
outcome of treatment [4, 5, 7, 9, 10, 11, 12, 
13]. The agreement among previous authors 
is especially striking in view of differences in 
definitions of affect and improvement, and in 
treatment and interpretation of data. It thus 
seems likely that previous findings are based 
upon a real correlation between whatever is 
generally understood by affect and the tenden- 
cy of hospitalized mental patients to improve. 
In this study the hypothesis that this relation- 
ship holds true when previously uncontrolled 
prognostic variables are held constant was in- 
vestigated. 


Procedure 


The general plan of this study was to rate 
mental patients through study of their case 
histories on (a) degree of affective expression 
during mental illness and (4) later recovery 
from mental illness. The relationship between 
these two ratings when no controls were main- 
tained was then compared with the same rela- 
tionship when other prognostic variables were 
controlled. Specifically, the study involved se- 
lection of case records from the files of a men- 
tal hospital, construction and use of a scale of 


1This paper is based upon a master’s thesis sub- 
mitted by Jean Bayard to the graduate school of the 
University of Pittsburgh in February, 1952. The 
authors express their appreciation to Drs. Mary Cole, 
Dorothy Feldman, and Clifford Swensen, who con- 
tributed basic data which were used in all studies 
in this series [see 8]. 


2Formerly at the University of Pittsburgh. 


affective expression and of a criterion for later 
improvement, control of variables significantly 
related to improvement, and comparison of cor- 
relation coefficients obtained before and after 
such control. 


Selection of cases. Four hundred and eighty- 
six records from the files of the University of 
Pittsburgh School of Medicine, Western Psy- 
chiatric Institute and Clinic, were used in this 
study. These records represented only patients 
diagnosed as functionally disordered without 
complicating organic disease or mental de- 
ficiency. A more detailed description of the 
group is given elsewhere [8]. 

The records had been compiled by various 
workers over a period of seven years. It should 
be recognized that in a field in which termi- 
nology is ambiguous and unsettled, data from 
such a source must be subject to certain limi- 
tations of accuracy. 


A scale of “affective expression.” A basic 
problem in constructing a scale of the “expres- 
sion of affect” is deciding just what the word 
affect means. There seems to be general agree- 
ment that the term is related to, if not synony- 
mous with, terms like emotion, feeling tone, 
and mood, but an exact definition seems to be 
lacking. Perhaps the clearest idea of how such 
terms have been used in the past is to be gained 
from a consideration of criteria used by pre- 
vious writers in judging these qualities. At 
least thirteen different criteria have been used. 


1. Expressions of apprehension, fear, or irritability 
[4]. 

2. Self reports of “feeling” [14]. 

3. Numerous complaints [3]. 
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Prognostic Criteria 


4. High self-ratings on scales of anxiety feelings, 
disturbing memories, feelings of personal in- 
adequacy [6]. 

5. Laughte: or weeping if they seem genuine [9]. 

6. Certain tonal qualities of speech [14]. 

7. Facial expression indicative of emotion [14]. 

8. Stupor [10]. 

9. Suspiciousness [10]. 

0. Elation and/or depression [10]. 

1. Disturbed visceral function, especially sympa- 
thetic [3]. 

12. Changes in muscle tonus [14]. 

13. Desperate, excited behavior [3]. 


~— 


For this study, scale definitions expressed in 
terms of the material found in case histories 
were desired. Review of representative case 
histories showed that in most histories descrip- 
tions of actual behavior during illness were 
given. These included some of the “signs” 
listed above and other behavior which several 
judges agreed might be considered prompted 
by emotion. Opinions of various examiners 
about the patient’s emotional tone also occurred 
frequently in the records in the form of such 
descriptions as “flattened affect” and “blunted 
emotionality.” 


For purposes of this paper, then, affective ex- 
pression was defined as the extent to which a 
patient’s record included descriptions of behav- 
ior generally considered indicative of emotion 
and judgments about positive affect. 


In constructing a scale of affective expres- 
sion, thus defined, 50 case histories were drawn 
at random from the sample of 486 cases. For 
each case, a card with a summary of signs of 
affective expression was prepared. An attempt 
was made to include all material in the records 
which might indicate any degree of emotional 
“tonus,” including signs of spontaneity, stub- 
bornness, shyness, etc., as well as grosser indi- 
cations such as crying spells, agitated behavior, 
and facial expression indicative of feeling. Four 
independent judges were then asked to sort 
these cards into five categories according to 
depth of affective expression as they under- 
stood it. 


Each case was then assigned the average of 
the four categories assigned to it. Three out of 
four judges had agreed on 32 cases. These 32 
cases were studied in an effurt to abstract 
those signs of affective expression frequently 
present in a single category but rarely found in 


: Affective Expression 
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other categories. These signs were then used as 
bases for definitions of five points on a scale. 
Intermediate points were set up for cases fall- 
ing slightly above or below the five major 
scale points. Further experience in rating rec- 
ords resulted in changes in several definitions, 
but in general the completed scale reflects the 
combined judgments of at least four judges. 
Five of the nine scale definitions are given 


below. 


1. Apathy is so profound that the subject needs 
special help in fulfilling his basic body needs. He is 
mute for long periods of time and gives practically 
no signs of interest or spontaneity. He may require 
spoon or tube feeding and bathroom care, and may 
not move unless forced, even when obvious danger 
is impending. There may have been brief and 
quite infrequent periods of violence, however, and 
occasional “silly” laughter and grimacing. 


3. A general picture of indifference and apathy is 
broken only by occasional but fairly definite signs 
of feeling, such as some show of bashfulness, wor- 
ry, or joy, or periods of crying, resistiveness, or ex 
citement. 

5. Average emotional display. Either (a) emo- 
tional display seems adequate and normal, neither 
blunted nor exaggerated, or (4) rather exaggerated 
emotional display is balanced by evidences of some 
defect in emotionality, such as an indifferent facial 
expression, lack of spontaneity, or a complacent at- 
titude. 


7. Emotional display is definitely exaggerated, 
with little if any evidence of apathy. Subject is al- 
most constantly depressed, elated, angry, or worried, 
displaying emotionality verbally and through ap- 
propriate facial expression, posture, and gestures. 
Only occasionally does he display emotion through 
physical agitation, however; he weeps’ but seldom 
has hysterics or tears his clothes; he appears quite 
tense but does not constantly tremble, pace wildly, 
or beat upon the walls of his room. 


9. Subject is so preoccupied with his emotions 
that his efficiency in carrying out the daily routines 
of living is impaired, and he no longer seems to care 
about his own welfare. In this category belong most 
subjects who exhaust themselves with overactivity, 
who make serious attempts at suicide, or who, in the 
extremes of grief or depression, no longer eat or 
move about. 


In rating subjects on this scale, all evidences 
of emotionality in the case history from the 


8The complete scale, with examples of case sum- 
maries at each scale point, is printed in Jean Bay- 
ard, “Studies of Prognostic Criteria in the Case His- 
tories of Hospitalixved Mental Patients. V. Affective 
Expression.” Unpublished master’s thesis, Univer. of 
Pittsburgh, 1952. 
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time of onset of mental illness through admis- 
sion to Western Psychiatric Institute and 
Clinic were considered. In general, an attempt 
was made to balance frequency and intensity 
of emotional display over the duration of ill- 
ness in order to arrive at an estimate of “aver- 
age” emotionality throughout the attack. Each 
rating thus represented the emotional display 
supposedly most nearly characteristic of the 
patient over a period of time. 

‘The importance of subjective interpretation 
on the part of raters using this scale must be 
emphasized. An attempt was made to rate each 
subject on the basis of a general, integrated im- 
pression of his behavior during illness rather 
than according to any rigid criteria. Each sign 
of emotionality was interpreted according to 
the rest of the subject’s behavior. For instance, 
inappropriate giggling might be taken as auto- 
matic, emotionless grimacing in a catatonic pa- 
tient, and as an outlet for nervous tension in a 
somewhat tense psychoncurotic. Slowing of re- 
sponses and lack of spontaneity were taken as 
signs of emotional blunting in an otherwise in- 
different patient, and as signs of extreme feel- 
ing in a grief-stricken patient who had several 
times seriously attempted suicide. 


Each of the 486 case records was read and 
rated with respect to this scale. A second judge 
independently rated 40 of these records se- 
lected at random from the files. Product-mo- 
ment correlation between ratings assigned to 
the 40 patients by the two independent judges 
was .81. This figure was taken as an estimate 
of the reliability of the scale. 


The criterion for improvement. Affective 
expression was to be studied in relation to a cri- 
terion for improvement. The criterion used 
was status one year after discharge from the 
hospital. Patients who, at that time, seemed to 
be functioning at approximately as high a level 
of efficiency as before illness were judged to be 
improved. Patients were judged unimproved 
if, one year after discharge, they were in other 
mental hospitals, were incapacitated to the 
point of being unable to work, or seeraed other- 
wise unable to deal as effectively with their en- 
vironments as others of similar status. Border- 
line cases were assigned to one category or the 
other on the basis of available evidence. 

More complete information about the cri- 
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teria of improvement has been published [8]. 

Control of significant variables. Available 
data [8] for the population indicated that each 
of the following continuous variables was very 
significantly related to the criterion for im- 
provement: duration of illness, hospital stay, 
treatment, direction of aggression, type of 
onset, and precipitating stress. Two noncon- 
tinuous variables, diagnosis and orientation, 
were also very significantly related to the cri- 
terion. 

The correlation between each of these vari- 
ables and affective expression was computed. 
All eight of these variables were then con- 
trolled by matching a group of improved pa- 
tients with one of unimproved patients on the 
eight variables. The two groups, improved and 
unimproved, were so selected that biserial cor- 
relation between improvement and each of the 
six continuous variables had a probability value 
higher than .05. Each group had the same 
number of cases in each category of the non- 
continuous variables, diagnosis and orienta- 
tion. This matching reduced the number of 
cases in each group to 90. 


The correlation between the improvement 
criterion and affective expression in these 
matched groups was then computed. Since di- 
agnosis was very significantly related both to 
affective expression and to improvement 
[see 8], the correlation between affective ex- 
pression and improvement was also computed 
when improved and unimproved groups were 
matched on diagnosis alone. 


Results 


A biserial correlation of .33 was obtained 
between ratings of affective expression and 
the improvement criterion, status one year af- 
ter discharge. This correlation coefficient is 
significant at the 1 per cent level. 

The correlation coefficients obtained be- 
tween affective expression and each of the 
eight other variables significantly related to the 
improvement criterion indicated the importance 
of controlling these variables in studying af- 
fect. Seven of these eight coefficients were sig- 
nificant at the 1 per cent level. (These cor- 
relations have been described [8].) 

It was found that when these variables were 
held constant by matching improved and un- 
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improved groups, biserial correlation between 
the improvement criterion and affective ex- 
pression dropped from .33 to .05, and was no 
longer significant. Mean affective expression 
ratings on the nine-point scale in the total, un- 
matched groups were 5.85 for improved and 
4.91 for unimproved groups, with standard 
deviations of 1.69 and 1.82 respectively. In the 
matched groups of 90 each, the mean for the 
improved was 5.38, for the unimproved 5.52, 
with sigmas of 1.51 and 1.90. 

In an attempt to determine at just what 
points in the matching the relationship between 
afiective expression and the improvement cri- 
terion had been lost, the correlation between 
these two variables was computed when only 
the closely related variable of diagnosis was 
controlled. It was found that biserial correla- 
tion dropped from .33 among 486 unmatched 
patients to a nonsignificant .13 among 320 
patients matched on diagnosis alone. 


Discussion 

Owing to imposing differences in methodol- 
ogy, results of this study are only roughly com- 
parable with those of previous studies. In gen- 
eral, however, former studies indicate a posi- 
tive but quite imperfect correlation between 
afiect and the tendency to improve. The low 
but significant correlation of .33 obtained here 
does not seem incompatible with these previous 
findings. However, in most previous studies 
positive relationships between affect and re- 
covery were reported when only one diagnostic 
category of mental patient was used. ‘The fact 
that in this study control of diagnostic cate- 
gory alone resulted in a drop of the correlation 
to a nonsignificant .13 thus seems to be at 
variance with previous findings. 

Some of the correlation between affective 
expression and the other prognostic variables 
is probably an artifact of the scale of affective 
expression. The highly significant relationship 
with diagnosis undoubtedly reflects the fact 
that some of the criteria on which diagnosis is 
often based were also used in judging affec- 
tive expression. Affective blunting, for example, 
may be considered a symptom of schizophrenia, 
while depression and elation are taken as man- 
ic-depressive signs. The correlation with dura- 
tion of illness may be due partly to the fact 
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that affective expression ratings were meant 
to be estimates of average affect throughout 
illness, rather than of intensity of single dis- 
plays of affect. As a rule, intense affective ex- 
pression could be maintained only throughout 
short illnesses, so that patients who had been 
ill for long periods were often rated low in af- 
fective expression, even though they might 
have displayed intense affect on occasion during 
the illness. Ratings on treatment were 
meant to reflect the degree to which patients 
received somatic treatment, such as electro- 
shock and lobotomy. One factor in the relation 
between treatment and affective expression 
may be the fact that, from the viewpoint of 
the patient’s prognosis as well as that of ease 
in caring for him, somatic treatment such as 
lobotomy is more likely to be considered for 
emotionally responsive patients than for lethar- 
gic patients [3]. The correlation between di- 
rection of aggression and afiective expression 
might have been expected in view of the high 
correlation between each of these variables and 
diagnosis. 

The fact that affective expression loses its 
significant relation to prognosis when eight 
other variables are controlled indicates that 
compositely the other variables include virtual- 
ly all aspects of affective expression which 
are related to prognosis. This does not neces- 
sarily mean, however, that afiective expres- 
sion would be given no weight in that com- 
posite of variables which would predict the 
criterion most accurately. 

Results of the study as a whole demonstrate 
the importance of controlling related factors 
in the study of single prognostic variables. 


Summary 


A scale of affective expression was con- 
structed and used in rating 486 hospitalized 
mental patients through study of their case his- 
tories. A biserial r of .33 between these rat- 
ings and status one year after hospital dis- 
charge indicated a highly significant relation- 
ship between affective expression and the 
tendency to improve. When improved and un- 
improved groups were matched on eight other 
variables significantly related to status after 
discharge, however, a biserial correlation of 
only .05 was obtained. Further study of the 
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data showed that control of a single variable, 
diagnosis, was enough to lower correlation be- 
tween affective expression and status after 
discharge to a nonsignificant .13. 
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On the basis of clinical observation, psy- 
chiatrists have tended to assume that an acute 
onset of mental illness is a favorable prognostic 
sign, and insidious onset is an unfavorable 
sign [6, 8, 9]. Uncontrolled clinical studies 
have provided tentative evidence in favor of 
this point of view [1, 3, 4, 5, 10, 11]. Bellak’s 
review of the literature on dementia praecox 
[2, pp. 403-404], and Chase and Silverman’s 
earlier review [4] show that most of the 
studies have produced evidence indicating that 
acute onset is a good prognostic sign and in- 
sidious onset is not. These studies have in- 
cluded patients having various diagnoses. 


None of the previous studies has attempted 
to control for the effect which the relationship 
between other variables significantly related to 
outcome of ncntal illness and type of onset 
might have upon the relationship obtaining be- 
tween type of onset and outcome. The purpose 
of this study was to assess the relationship be- 
tween type of onset and outcome when the ef- 
fect of some of the other significantly related 
variables had been controlled. 


Method 


The data used in this study were obtained 
entirely from case histories of patients at the 
Western Psychiatric Institute and Clinic 
(WPIC), University of Pittsburgh. All the 
case records of patients admitted to WPIC 
since November, 1942, and discharged prior to 
July, 1950, were used. All cases discharged af- 
ter July, 1950 were omitted so that there 


1Based upon a portion of a dissertation by the 
senior author presented to the Graduate School of 
the University of Pittsburgh in partial fulfillment 
of the requirements for the degree of Doctor of 
Philosophy. 

2At the University of Pittsburgh when this re- 
search was done. 
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would be at least a one year follow-up of every 
case. A total of 1,118 cases met these criteria. 
The cases included in this study were selected 
from the 1,118 on the basis of the following: 
age between 15 and 55, lack of known brain 
damage, absence of mental deficiency, absence 
of serious physical illness, absence of previous 
attacks of mental illness. ‘The only cases ex- 
cluded on the basis of having previous attacks 
of mental illness were those who had apparent- 
ly recovered from the previous attack, so that 
the present cause of hospitalization was due to 
a separate and distinct attack. As a result, 
many patients included in the study had been 
transferred to WPIC from other general or 
mental hospitals and, in some cases, had been 
treated at the other hospitals. 


After the criteria had been applied, there 
remained 486 cases for use in the study. A pre- 
vious paper [7] contains a fuller description 
of this sample and notes that the sample is 
similar in composition to those used in other 
studies. : 

The patients were judged to be either “im- 
proved” or “unimproved” one year following 
their discharge from WPIC. A patient was 
judged to be improved if he was working at 
a level of efficiency that appeared to be compar- 
able to his level prior to becoming sick. A case 
was judged to be unimproved if the indi- 
vidual was still in a mental institution, had 
been returned to a mental institution, or was 
out of the hospital but not performing his 
regular work in an acceptable manner. The 
information upon which this judgment was 
based was obtained from the reports of social 
workers and psychiatrists, and recorded in the 
case histories. For the unimproved cases the 
judgment was based upon the records of the 
hospitals in which they were patients at the 
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time of the follow-up report. 


‘Type of onset was measured by a rating 
scale. The scale consisted of nine points, five 
of which were defined. Points 1, 3, 5, 7, and 
9 were defined, and points 2, 4, 6, and 8 were 
used as intermediate points in order to rate 
cases that appeared to fall between the de- 
fined points on the scale. The complete scale is 
contained in another paper [13]. A summary 
of the scale is presented below: 


Point one 
Sudden onset. Illness developed overnight or over 
a period of a few days. 


Point three 

Fairly rapid onset. Illness developed over a period 
of a few days. 

Point five 

Onset neither sudden nor insidious. Illness developed 
over a period of several months or a year or two. 
Point seven 

Onset fairly insidious. Illness developed over a per- 
iod of two to five years. 

Point nine 

Onset insidious. Illness developed over a period of 
six years or more. 


The reliability of the full scale was deter- 
mined by having two independent judges rate 
40 cases, and correlating the two sets of ratings. 
The correlation was .80, indicating fairly good 
reliability for the scale. 

‘Twenty other variables were also used in 
this study. They were: sex, age, marital status, 
nationality, occupation, economic level, body 
type, education, intellectual status, affective 
expression, orientation, direction of aggression, 
diagnosis, age at onset cf illness, duration of 
illness, length of hospitalization, status upon 
discharge from WPIC, precipitating stress, 
treatment, and religion. A fuller description of 
the measurement of these variables is contained 
in a previous paper [7 ]. 

The relationship between these variables and 
outcome of illness was then determined. For 
the continuous variables the relationship was 
determined by the biserial coefficient of corre- 
lation, and for the noncontinuous variables the 
relationship was determined by the chi-square 
technique. Eleven variables were found to be 
related to the outcome of mental illness at the 
.O1 level of confidence. They were: marital 
status, affective expression, orientation, direc- 
tion of aggression, diagnosis, type of onset, 
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duration of illness, hospital stay, status on dis- 
charge, precipitating stress, and treatment. 
The relationship between these variables and 
outcome is discussed more fully in a previous 
paper [7]. 

‘The biserial coefficient of correlation be- 
tween type of onset and outcome was .31, as is 
noted in Table 1. The interrelationships be- 


Table 1 


Summary Statistics for Total Group 
and Controlled Sample Group 











Controlled 
Statistic Total group sample group 
N 486 200 
Mean rating-scale points 
Improved 4.68 4.78 
Unimproved 5.74 5.60 
Standard deviation 
Improved 2.17 2.24 
Unimproved 1.94 1.69 
t 5.67* 2.93* 
Thigs ONsSet vs. outcome 





* Significant at .01 level. 


tween onset and the variables that are signifi- 
cantly related to outcome are presented in 
Table 2. It will be noted that onset is related 


Table 2 


Relationships between Type of Onset and the Other 
Significant Variables 











Variable Statistic p Value 
1. Affective 

expression aa >.05 
2. Orientation chi square — 10.6 01 
3. Direction of 

aggression f= 2 01 
4. Diagnosis chi square — 11.9 .02 
5. Duration of 

illness r= $9 01 
6. Precipitating 

stress r= Al 05 
7. Treatment chi square — 19.3 01 
8. Marital 

status chisquare— 6.1 >.05 





at the .01 level to four of these variables. 
These variables are: 


1. Orientation. Disorientation tends to be 
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related to an acute onset. 


2. Direction of aggression. Aggression di- 
rected outward tends to be related to an insidi- 
ous onset and aggression directed against the 
self tends to be associated with an acute onset. 


3. Duration of illness. A long illness tends 
to be associated with an insidious onset. 


4. Treatment. Shock therapy and lobotomy 
are more often given to those patients with 
an acute onset. 


Control of the significant variables. ‘Then 
the original sample of 486 cases was divided 
into two groups, an “improved” group of 234 
and an “unimproved” group of 252. Cases 
were then dropped from the two groups until 
there were no significant differences between 
them on any of the variables significantly re- 
lated to outcome, as is indicated in Table 3, 
with the exception of type of onset. Type of 
onset was ignored during this procedure. A 


Table 3 


Differences between Improved and Unimproved 
Controlled Groups on Significant Variables 











(N = 200) 

Variable Statistic* 
Affective expression t= .52 
Orientation chi square — 1.58 
Direction of aggression t= .38 
Diagnosis chi square— _ .00 
Duration of illness t= .06 
Hospital stay f= 36 
Precipitating stress [== mt 
Treatment chi square— .10 


Marital status chi square — 1.10 





* None significant at .10 level. 


check revealed that there were no significant 
differences between either of the groups on 
any of the variables not significantly related 
to outcome. When this procedure was com- 
pleted there were 200 cases left, 100 improved 
and 100 unimproved. The relationship between 
type of onset and outcome of illness was then 
determined. 


Results 
The results, in Table 1, show that there is 
a significant difference between the improved 
and unimproved groups in type of onset. 
The group that improved tended to have a 
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more sudden than 
group. 

Earlier it was mentioned that for the total 
group of 486 the correlation between type of 
onset and outcome was .31. For the final, con- 
trolled, groups the correlation between onset 
and outcome was .25. The predictive value of 
the type of onset is reduced comparatively little 
by the introduction of the controls used in this 
study. Therefore, type of onset, in itself, seems 


to be a prognostic sign of some significance. 


onset the unimproved 


Table 4 shows the distribution of the groups 
for types of onset. It will be noted that for an 


Table 4 
Distribution of Patients in the Groups by 
Percentage Having Various Types of Onset 








Un- 





Type of Improved improved Total 
onset group group group 
Acute (1-3) 37% 13% 
Gradual (4-6) 56 51 43.5 
Insidious (7-9) 27 36 31.5 
All cases 


100 100 100 





acute onset 37 improved while only 13 did not 
improve. At the other end of the scale, 27 with 
an insidious onset improved while 36 did not. 
For this study, at least, there seems to be a 
greater difference between the two groups at 
the acute end of the scale than at the insidious 
end of the scale. It might be suggested that an 
acute onset is more indicative of good prog- 
nosis than an insidious onset is indicative of 
poor prognosis. 

The mean “type of onset” rating for the im- 
proved and unimproved groups by diagnostic 
category may be found in Table 5. It will be 


Table 5 
The Differences between the Improved and 
Unimproved Groups on Type of Onset by 
Diagnostic Category 











Diagnostic Mean* 

category N Improved Unimproved tf 
All psychotic 124 4.16 5.44 3.568 
Nonpsychotic 76 5.79 5.76 07 
All cases 200 4.78 5.60 2.93%* 





* Based on nine-point rating scale. 
** Significant at the .01 level of confidence. 
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noted that type of onset seems to be of 
prognostic importance only in the case of the 
psychoses. 

On the other hand, it will be noticed that 
the nonpsychotic patients do not differ signifi- 
cantly on onset. Type of onset seems to be a 
significant prognostic sign for psychotics, but 
not for nonpsychotic mental patients. 

It seems safe to conclude that onset is a re- 
liable prognostic indicator. It may also be sug- 
gested that onset is a fairly “pure” indicator 
since the control of the other significantly re- 
lated variables reduced the correlation between 
onset and outcome only from .31 to .25. 


A second and less reliable conclusion is that 
onset is of prognostic importance only in the 
case of psychotic patients and not in the case 
of nonpsychotic patients. 


Summary 


The purpose of this study was to determine 
the relationship between the type of onset of 
mental illness and outcome of mental illness 
when some of the other variables that are sig- 
nificantly related to mental illness have been 
controlled. The sample consisted of 486 cases 
of functional mental illness. 


The relationship between the outcome of 
illness one year following discharge from the 
hospital and 21 variables was determined. It 
was found that 11 of these variables were sig- 
nificantly related to the outcome of illness. 


The total sample was divided into two 
groups, one made up of patients who had been 
improved one year following discharge, and 
one of those who had been unimproved one 
year following discharge. In order to control 
all relevant variables except type of onset, the 
two groups were matched on all the other sig- 
nificant variables. It was necessary to drop 
cases from the original sample of 486 in order 
to achieve the matching, leaving 200 cases, 100 
improved and 100 unimproved. 

With ali relevant variables controlled, the 
improved group had a significantly more sud- 
den onset than the unimproved group, and type 
of onset correlated .25 with the outcome. 
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When the results were analyzed by diagnos- 
tic category, it was found that the improved 
psychotic patients had a significantly more 
sudden onset than the unimproved psychotic 
patients, but that there was not a significant 
difference between the improved and unim- 
proved nonpsychotic patients. 


Received July 1, 1953. 
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The results of a previous study [1] showed 
significant relationships between scores on the 
Moss Social Intelligence test [2] and the 
Rosenzweig Picture-Frustration Study [3]. 
The results of particular interest to the 
present study were the significani relation- 
ships obtained between the Social Intelligence 
test subtest entitled “Recognition of the Men- 
tal State of the Speaker” and certain scoring 
categories of the Rosenzweig Picture-Frustra- 
tion Study. These results indicated that the 
ability to infer a person’s mental state from 
written quotations was significantly related to 
the way in which he responded to the various 
Picture-Frustration Study (PFS) situations. 
They suggested the possibility that people may 
differ in the way in which they interpret the 
behavior in each of the cartoon situations in 
the PFS and that these differences may be 
importantly related to the characteristics of 
their response. 

To explore this possibility further, the PFS 
was used with a different set of instructions 
and presented to a group of 50 college males. 
These instructions were to supply the word 
which best characterized the mental state of 
the person “doing the talking” in each of the 
24 situations. From this material a form con- 
sisting of 24 multiple-choice items was prepared. 
The alternatives for each item were selected 
to include a clearly normative response and 
four or five “reasonable” alternatives. The test 
with this form (for convenience hereafter called 
the Picture-Frustration Identification Test or 
PFIT) was then administered to a second 
similar group of 50 college males with the 
following instructions: 
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In each of the 24 cartoon drawings you will no- 
tice one person saying something to another person. 
For each cartoon select the word among the various 
alternatives offered in the accompanying answer 
sheet which best describes the mental state of the 
person doing the speaking. 

The 24 sets of alternatives which constitute the 
PFIT are: 


1. (a) sarcasm (b) condescension (c) embarrass- 
ment (d) fear (¢) regret 

2. (a) resentment (+) anger (c) annoyance (d 

sorrow (¢) sympathy 

(a) pity (b) sympathy (c) anger (d 

(¢) irritation 


w 
. 


disgust 


4. (a) apprehension (4) guilt (c) despair (d) 
gret (¢) indifference 

5. (a) anger (b) resentment (c) annoy: 
distrust (¢) impatience (f) disgust 

6. (a) officious (4) sympathy (c) 
rigidity (¢) tact (/ 

7. (a) sarcasm (b) vexation (°° 
dignation (¢) boredom 


we d 


sarcasm (d 


irritation eo ; 
) hostiJity (d) i 


F Bae logetic (c) arrogant 
8. (a) inquisitive 5 


fearful (¢) sor: 
9. (a) authoritatiy 
dependency («¢ 
hb mi ou ‘ 
10. (a) hatred awe 
annoyance -—_ 
11. (a) rude — 
(d) repstet (¢) 
ox 1] 
12. (a) s PR 
gret ¢(¢) sympathy 
13. (a) tee 
(gut) spite ¢ 
14, ( (a) distress () 
appointment (¢) hb 


sarcasti 


‘Ness 
nfusi 


indifference concerfr! 


forcefulness (/ arrogance (¢ ndifferen 

mndescensio 
impatience wrath (d) dis 

ility 

b) joviality (c) courteousness 


15.° (a) humility 
it (d) self-deprecation (ce) fear 


1¢4. (a) 
ye stubborn (¢) 


insensitive (b) assertive (c) hostile (d) 


officious 
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17. (a) sarcasm (0b) critical (c) impatience (d) 
disgust (¢) hatred (f) annoyance 

18. (a) regret (b) indifference (c) sympathy (d) 
sincerity (¢) inconsiderate 

19. (a) contemptuous (b) overbearing (c) sarcastic 
(d) irate (¢) indignant 

20. (a) regret (b) apprehensior (c) envy (d) dif- 
fidence (¢) bewilderment 

21. (a) matter-of-fact (b) contempt (c) anger (d) 
righteous (¢) indignant (f) hatred 

22. (a) sarcasm (5) sadism (c) regret (d) con- 
cern (¢) amusement (f) condescension 

23. (a) annoyance (b) resignation (c) disgust (d) 
surprise (¢) joy (f) tolerance 

24. (a) callous (+) regret (c) indifference (d) em- 
barrassment (¢) shame 


Two weeks later the PFS was administered 
to this group in the conventional manner. It 
was expected that the present study would re- 
veal more strongly the relationships found in 
the earlier study because in this case both per- 
ception and response referred to the same situ- 
ation. 


Results and Discussion 


The relationship between the scores on the 
PFIT and the various categories of the PFS 
is analyzed in Table 1 in which the contingen- 
cy tables and associated chi-square values be- 
tween the scores on the PFIT and the various 
scoring categories of the PFS are shown. 

The PFS score was obtained following Ros- 
enzweig’s [3] standard procedure. The PFIT 
score consists of unit weight for a normative 
response to each of the \24 items. The scores 
on the PFIT were divided, on a median split, 
whereas the scores for each .category of the 
PFS were divided approximately into thirds 
since in each scoring category to many cases 
fell directly on the median, makiag dichoto- 
mization unfeasible. Thus, all compay‘isons are 
based upon 3 X 2 contingency tables. Inspec- 
tion of this table shows four out of seven of 
the chi squares to be highly significant, The 
relatively small number of cases makes imter- 
pretation of these values somewhat hazardous 
but is large enough to suggest that the type of 
performance tapped by the PFIT warrants 
further study. It should be noted, however, 
that the pattern of frequencies obtained in the? 
contingency tables for Extrapunitive (EF) 


Table 1 
Contingency Tables and Chi Squares for the 
Picture-Frustration Study versus the 
Picture-Frustration Identification Test 











(N = 50) 
PFIT score 

P-F score High Low x p 
Extrapunitive 

High 8 10 

Middle 5 il 

Low 12 4 6.50 <.05 
Intropunitive 

High 12 7 

Middle 3 12 

Low 10 6 7.34 <.05 
Impunitive 

High 12 4 

Middle 8 8 

Low 5 13 7.32 <.05 
Obstacle-Dominance 

High 9 7 

Middle 7 9 

Low 9 9 1.75 >.10 
Ego-Defense 

High 7 9 

Middle 7 10 

Low 11 6 2.25 >.10 
Need-Persistence 

High 14 3 

Middle + 12 

Low 7 10 12.38 <.01 
Denial 

High 7 12 

Middle 12 5 

Low 6 8 4.45 >.10 





and Intropunitive (J) makes it difficult to in- 
terpret the meaning of the significant chi 
squares obtained with these categories. For 
example, chi square obtained with the J cate- 
gory is difficult to interpret because of the U- 
shaped distribution of frequencies in this con- 
tingency table (cf. Table 1). This table in- 
dicates that a high PFIT score tends to go 
with either a high or low J score, whereas a 
middle score on I is associated with a low 
PFIT score. In this case it is difficult to in- 
terpret what the significant chi square means. 

The relationships in the contingency table 
for E show a negative relationship to the PFIT 
score. The pattern of frequencies here is not 
so difficult to interpret as in the case of J. The 
distribution of these frequencies suggests that 


ote 
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low E’s tend to achieve high PFIT scores 
more clearly than high E£’s tend to achieve 
low PFIT scores. Inspection of the contingen- 
cy table for Impunitive (1/7), however, sug- 
gests a fairly straightforward relationship be- 
tween M and PFIT score with a majority of 
the low M’s tending to achieve lower scores, 
the middle M’s splitting, and the majority of 
high M’s achieving higher PFIT scores. ‘The 
Need-Persistence (N-P) category is the last 
category for which a significant chi square was 
obtained. Inspection of the contingency table 
indicates consistent distribution of frequencies 
for the high and low N-P categories in that 
the majority of the low N-P’s got low PFIT 
scores and the majority of the high N-P’s gor 
high PFIT scores. 


The results of the present study partly con- 
firm the findings of the previous study in which 
significant chi squares were obtained between 
the Social Intelligence test subtest entitled 
“Recognition of Mental State of the Speaker” 
and the E and M scoring categories of the 
PFS. The two studies did not agree in that 
no significant chi squares were obtained for 
N-P and I in the earlier study; however, J 
was significant at the .09 level. 

There seems to be, then, strong indication 
that the character of people’s responses to these 
situations is related to the way in which they 
perceive the person to whom they are respond- 
ing. A comparison of the pattern of frequencies 
in the contingency tables for PFS categories 
E, I, M, and N-P suggests the possibility that 
the E and J categories are not as perceptually 
homogeneous as are the M and N-P categor- 
ies. Thus, as noted above, it was found that 
only for low E’s was there a consistent tenden- 
cy to make high PFIT scores, whereas for 
high F’s the PFIT scores were both high and 
low. Either this means that there is no signifi- 
cant relationship between the two tests, or 
else high E individuals are perceptually more 
heterogeneous than low E individuals. To the 
extent that the way in which a person perceives 
the situation is important for understanding 
his personality dynamics, it may be that high 
E scores are more complex to interpret than 
low E scores. It will be of interest to explore 
the question of whether high E individuals who 
obtain low PFIT scores reveal a socially less 
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“appropriate” pattern of aggression than indi- 
viduals who receive high E scores as well as 
high PFIT scores. This question can be ex- 
amined by qualitative analysis of the responses 
made by high-E individuals. It might be found 
that persons who make both high E and PFII 
scores make more ‘appropriate’ aggressive re- 
sponses since these are conditioned by more ap- 
propriate perceptions. There was not a suffi- 
cient number of cases available in the present 
study to make this kind of detailed analysis. 


A similar analysis may reveal the meaning 
of the pattern of frequencies obtained for the 
I category. On the basis of these frequency 
patterns, the interpretations of the meanings 
of similar relationships obtained in the previ- 
ous study, while not necessarily incorrect, ap- 
pear oversimplified. Examination of the pattern 
of frequencies for the M category does not sug- 
gest the need for any essential changes in the 
interpretation made in the earlier study with 
regard to its relationship to the PFS. Briefly, 
it was suggested that the J/-type person avoids 
placing blame and minimizes the frustrating 
features of a situation. It was assumed that the 
basis for this behavior lay in his desire to pro- 
tect the feelings of others and would thereby 
result in an increased awareness and sensitivity 
to their mental states. 

The significant chi square obtained for N- 
P was not found in the earlier study. Other 
things equal, the high-N-P individual tends to 
be well adjusted in that he maintains realistic 
contact with the requirements of a situation. 
The primary orientation signified by N-P is a 
constructive one involving achievement of goals 
or solution of problems. On this basis it is 
reasonable to expect that he would tend to per- 
ceive more normatively the meaning of the be- 
havior of the other person in a social situation. 

In general, the results obtained for the M 
and N-P categories, both being suggestive of 
good adjustment, confirm the expectation 
that the appropriateness of one’s perceptions is 
an important aspect of good adjustment. 

It should be noted that the suggestive re- 
sults of the present study were obtained de- 
spite the fact that the PFIT was not well 
standardized and that a relatively small num- 
ber of cases was used. 
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Summary 


The present study explored the relationship 
between the scoring categories of the PFS and 
a derivative test (PFIT) designed to measure 
ability to perceive “appropriately” the mood 
or feelings of the individuals to whom the ex- 
aminee is responding in each of the PFS situa- 
tions. Significant relationships were found for 
four out of the seven major scoring categories 
of the PFS. These results partly confirmed 
and extended the results of an earlier study. 
Further exploration of the meaning of the per- 
ceptual aspects considered here is strongly sug- 
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gested with more cases and a similar but better 
standardized derivative test. 
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Self Concepts and Rorschach Signs of Depression’ 
Robert E. Bills 


University of Kentucky 


According to Lecky [7, p. 230] “All emo- 
tions can be traced directly to experiences 
which are interpreted by the individual as 
SUPPORTS OF OR THREATS TO one 
or more ideas of self... . An experience which 
is interpreted as a threat to one or more ideas 
of self, is a disorganizational experience and 
will yield negative emotional responses . . . .” 
Accordingly, self perceptions of a lack of unity 
within the personality or of a discrepancy be- 
tween the perceptions of self and the ideal self 
should be disorganizational experiences lead- 
ing to feelings of depression. 

In the following study it was hypothesized 
that people with a small discrepancy between 
concept of self and concept of the ideal self 
would show fewer signs of depression on the 
Rorschach than people with a large discrep- 
ancy. 


Design 

In order to test the above hypothesis, six 
groups of college students were tested with 
the Index of Adjustment and Values [3, 4, 8], 
and from these groups 56 subjects were 
chosen, using discrepancy scores on the Index 
as the criterion of selection. The Index re- 
quires a subject to rate himself three times on 
each of 49 traits, and the ratings are arranged 
in three columns termed concept of self, ac- 
ceptance of self, and concept of the ideal self. 
The differences between concept of self and 
concept of the ideal self for the 49 traits, sum- 
med without regard for sign, are called dis- 
crepancy scores and have been suggested as 


1A portion of the data for this study was col- 
lected as a part of a larger study in the improve- 
ment of educational administration sponsored by 
the W. K. Kellogg Foundation. The University of 
Kentucky project is directed by Robert L. Hopper, 
Director of the Bureau of School Services. The 
writer would like to express his thanks to Henry 
Oppenheim who gave and scored the Rorschachs. 
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measures of personal level of aspiration [5]. 
The mean discrepancy score of the standardi- 
zation population was 44.69 with a standard 
deviation of 16.90. Twenty-eight of the 56 
subjects had discrepancy scores at least one 
standard deviation above the mean discrep- 
ancy score of the standardization group, and 
28 subjects had discrepancy scores at least one 
standard deviation below the mean of the 
standardization group. Each of the two groups 
contained 14 male and 14 female subjects. 

Each of the 56 subjects was tested with the 
Rorschach, using Beck’s instructions [1], by 
an examiner who had no knowledge of the 
hypothesis being investigated nor of the dis- 
crepancy scores of the subjects. The system 
used to score the Rorschachs was a mixture of 
Beck [1] and Klopfer and Kelley [6]. Beck’s 
system was used to score location and to deter- 
mine form level. In determining F + % 
Beck’s tables were used to determine form 
level, and F + % was calculated from the 
formula: Good F divided by Rorschach F. 
Rorschach F is the total number of determi- 
nants minus the color and human movement re- 
sponses. All other scoring was from Klopfer 
and Kell!cy. 

Beck [2] states that depression affects a 
Rorschach record by lowering the total number 
of responses, increasing the time per response, 
lowering the color sum, increasing the F + %, 
and decreasing the number of W’’s. Klopfer 
[6], after a review of the literature, agrees 
with Rorschach [9] and states that depression 
causes a higher F + %, a more rigid succes- 
sion, a higher 4%, a lower M, a lower color 
sum, fewer responses, a longer reaction time, 
increase in F%, increase in human and animal 
details, a coarcted erlebnistyp, rejection of 
cards, and fewer W responses. 

The five signs which occur in both of the 
above lists were taken as the indicators of de- 
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pression for the present study, and in addition 
the W:M ratio was added because of its ex- 
tensive us: in clinical diagnosis. It was pre- 
dicted that the high-discrepancy subjects would 
have a lower W:M ratio than the low scorers. 
Thus, the subjects who scored high on dis- 
crepancy on the Index were compared with 
the low scorers on number of responses, number 
of W responses, W:M ratio, sum C, F + %, 
and T/R. 


Results 


The scores on each of the Rorschach fac- 
tors were divided at the median point of all 
56 subjects, or as near the median as possible, 
and this division was used to form one dicho- 
tomy of a double dichotomous distribution. 
The other dichotomy was formed by high or 
low discrepancy scores on the Index of Adjust- 
ment and Values. 

Number of responses. No difference ap- 
peared between the high and low scores on dis- 
crepancy in terms of the number of responses 
produced on the Rorschachs. Each of the cate- 
gories of the fourfold distribution contained 14 
subjects. The median number of responses was 
29.5. 

Number of W responses. Nineteen of the 
high scorers produced 8 or fewer W responses 
and 9 produced 9 or more W’s. Of the 28 low 
scorers 10 produced 8 or fewer W’s but 18 
produced 9 or more. This distribution gave a 
chi square of 5.793 which is significantly dif- 
ferent from zero at the .02 level of confidence. 

W:M ratio. Sixteen of the high-discrepancy 
scorers had fewer than two and one-half W’s 
for each M, and 12 equalled or exceeded this 
amount. Of the low scorers, only 8 had two 
and one-half W’s or fewer for each M, while 20 
had greater than this amount. This distribution 
yielded a chi square of 4.667 which is signifi- 
cant at the .05 level. 

Sum C. Twenty-one of the high-discrepancy 
scorers had a weighted color sum of 3.5 or less, 
and 22 of the low scorers had a color sum of 
4 or more. This distribution gave a chi square 
of 16.092 which is significant at the .001 level. 

F + %. Twenty-two of the high scorers had 
an F + % of 85 or more, whereas 21 of the 
low scorers had an F + % of 84 or less. The 
chi square of 16.092 which this distribution 
gave is significant at less than the .001 level. 
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T/R. The time per response of 16 of the 
high scorers was 33 seconds or more, while 
19 of the low scorers had an average time per 
response of 32 seconds or less. ‘The resulting 


chi square of 3.541 has a probability level of 
.06. 


Discussion 

Of the six indicators of depression, five 
were significantly different from zero at the 
.06 level or less. The high-discrepancy scorers 
differed significantly from the low scorers in 
number of W responses, W:M ratio, sum C, 
F + %, and T/R. There was no significant 
difference in the number of responses pro- 
duced by the two groups. 


On the basis of the findings of this study it 
may be concluded that a group of people with 
a high discrepancy between concept of self and 
concept of the ideal self differs from a group 
with low discrepancy scores in that the high 
scorers gave more signs of depression on the 


Rorschach. 


In an earlier paper [5] the discrepancy 
score of the Index of Adjustment and Values 
was described as a measure of personal level of 
aspiration. If this is a valid assumption, it may 
be concluded that people with a high personal 
level of aspiration suffer more from feelings 
of depression than do people with a low per- 
sonal level of aspiration. It is possible that the 
depressed feelings result from an examination 
of self and the ideal self with the conclusion 
by the person that the gap is so large that it 
cannot be bridged in his present state of ad- 
justment. Whatever the cause, it seems clear 
that if a person sets too high a personal level 
of aspiration he is more subject to depression 
than if he sets his level too low. 


Summary 


The hypothesis of this study was that de- 
pression is related to the discrepancy between 
the concept of self and the concept of the ideal 
self. The Rorschach records of 28 subjects with 
high discrepancy scores on the Index of Ad- 
justment and Values were compared with the 
records of 28 low scorers. Of the six Ror- 
schach factors chosen as indicators of depres- 
sion, five showed significant differences be- 
tween the two groups. It was concluded that 
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people with high personal levels of aspiration 
show more Rorschach signs of depression than 
people with low personal levels of aspiration. 
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The “Negative Self Concept” as a 
Personality Measure’ 


Emory L. Cowen 


University of Rochester 


A growing interest in the study of the self 
concept as a personality dimension is_ reflected 
in the recent development of four instruments 
[2, 3, 4, 11] purportedly measuring some as- 
pect of this variable. In a recent paper Brown- 
fain [4] suggests that “stability of the self- 
concept” may be an important dimension of 
personality. The latter measure is defined as 
the discrepancy between two types of self-rat- 
ings (i.e. the positive self concept and the 
negative self concept) summed without re- 
spect to sign for a series of twenty-five trait 
descriptive terms. The smaller the discrepancy 
between these diverse self-ratings, the more 
stable the self concept, and consequently the 
better adjusted the individual. Brownfain [4] 
presents data which tend to support the valid- 
ity of this measure as an index of good ad- 
justment.? 

Cowen,* in a study of the relationship be- 


1This investigation was supported in part by a 
research grant from the National Institute of Men- 
tal Health, of the National Institutes of Health, U.S. 
Public Health Service. This is the fourth in a series 
of papers emanating from this grant. 

The assistance of Mr. Fred Heilizer in carrying 
out the statistical analysis is gratefully acknowl- 
edged. 

2 Cowen, E. L. An investigation of some relation- 
ships between two measures of self-regarding atti- 
tudes. (In preparation) 


3In connection with Brownfain’s validity study, 
it is important to note that he eliminated 15 high 
scorers on the California F scale [1] from his final 
analysis of the differences between his high and low 
groups on the stability of self-concept dimension. He 
did this on the basis of a significant negative cor- 
relation between stability score and F scale score, 
reasoning that some subjects in the low discrepancy 
group were there as a function of rigidity (high F 
scale score) rather than because of a truly stable 
self-picture. By contrast in the present study, posi- 
tive but nonsignificant correlations were noted be- 
tween F scale and stability score for the two samples 
studied (p — .13 and .i7 respectively). 


tween the Brownfain‘* and the Bills, Vance, 
and McLean Index of Adjustment and Val- 
ues, found for two separate samples, that the 
stability of self-concept index failed to corre- 
late significantly with any of the Bills meas- 
ures, including an apparently similar type of 
discrepancy score based on self-concept ratings 
made from several frames of reference. On 
the other hand the two Brownfain measures 
of level of self concept (i.e. positive self con- 
cept and negative self concept) were found to 
correlate in the expected direction with these 
same Bills measures. For the first of the two 
samples studied it was noted that of the sever- 
al measures of self-regarding attitudes em- 
ployed, the negative self-concept measure ap- 
peared to relate most consistently to the other 
personality and _ sociopsychological variables 
for which data had been collected on the same 
group of subjects. This observation gave rise 
to the speculation that the negative self con- 
cept might, in fact, be a discriminating person- 
ality index. The purpose of the collection of 
data for the second sample was to provide con- 
firmatory evidence for the original findings. 


Procedure 


Data were collected independently for the 
two samples. Subjects in the first sample were 
58 college undergraduates, both male and fe- 
male. Subjects were given three tasks in indi- 
vidual administration: a water-jar test of 
Einstellung rigidity [6]; an alphabet-maze 
test of Einstellung rigidity [6]; and a task in- 


* Several modifications of the original usage of 
the Self-Rating Inventory were made. An 1i11- 
point rating scale was used instead of an 8- 
point scale and ratings were made only for the 
variables positive and negative self concept. Both 
ratings were recorded on a single rating scale for 
each trait descriptive term rather than on separate 
sheets as Brownfain had done. 
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volving perceptual response under conditions of 
“threat-expectancy” [5]. Later all subjects 
completed three inventories: the Bills, Vance, 
McLean Index of Adjustment and Values 
[3], the Brownfain Self-Rating Inventory [4], 
and the 30-item California F scale [1]. 

The 81 Ss in the second sample were also 
college undergraduates, both male and female. 
It was not possible to test these subjects indi- 
vidually, hence they were not given the percep- 
tion or rigidity tasks. All subjects in the second 
group did, however, take the Bills, the Brown- 
fain, and the F scale; hence they may be con- 
sidered a cross-validating group for these 
measures. In addition, Ss in the second sample 
were given two scales recently developed by 
Gardiner® measuring religious attitudes. These 
were the 13-item Theism scale (strength of 
belief in God) and the 11-item Ethics scale 
(strength of reliance on the church for one’s 
ethical code). 


Results, Discussion, and Conclusions 


The findings of a correlational analysis for 
the several Bills and Brownfain measures of 
self-regarding attitudes have been summarized 
in an earlier paper.® Suffice it to point out 
here the general tendency of the Brownfain 
negative self-concept measure to correlate sig- 
nificantly and in the expected directions with 
other indices of self-regarding attitudes. The 
results to be presented now derive from an 
analysis of the performance of extreme groups 


Table 1 


Properties of the Distributions of Negative Self- 
Concept Scores for Total Groups and High and 
Low Extremes for the Two Samples 











Mean Neg. ; 

Group S.C. Score Range Sigma 

Total, 58 143.1 86-184 23.5 
High, 17 169.2 161-184 
Low, 17 112.3 §6-126 

Total, 81 146.1 68-210 27.3 
High, 26 174.2 162-210 
Low, 21 109.8 68~133 





5 Gardiner, D. A study of religious attitudes. Un- 
published doctoral dissertation, Univer. of Roches- 
ter. (In progress) 


® See footnote 2. 
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selected on the basis of the negative self-con- 
cept score. The selection of the extreme groups 
for the two samples was based primarily on 
the occurrence of natural breaks in the distri- 
bution of scores for this variable such that the 
highest score in the selected “low” group, and 
the lowest score in the selected “high” group, 
fell at least one-half standard deviation from 
the mean. Table 1 summarizes the nature of 
the distribution of the two samples for the 
negative self-concept measure. 

The differences between the “high” and 
“low” groups on the negative self-concept 
measure for the criterion personality and so- 
ciopsychological variables are summarized in 
Tables 2 and 3 for the first and second samples 
respectively. 

inspection of Table 2 indicates that there are 
no differences between the means of the “high” 
and “low” negative self-concept groups on 
either the water-jar or alphabet-maze rigidity 
tasks, or for the discrepancy in perceptual 
threshold between threat and neutral words. 
For all other variables, however, clear-cut dif- 
ferences or very strong trends toward such 
differences exist between the two groups. In 
addition, the direction of these differences sug- 
gests in each case that the “high” negative self- 
concept group is functioning at a better ad- 
justive level than the “low” negative self- 
concept group insofar as the criterion indices 
are valid ones. Thus the “high” negative self- 
concept group scores significantly higher on 
the Bills self concept, self-acceptance, and ideal 
self-measures, and significantly lower on the 
Bills maladjustment index (self concept-ideal 
self-discrepancy) as well as the Brownfain 
stability of self-concept index (positive-nega- 
tive discrepancy). Though not significantly 
so, the high group tends to score lower on the 
California F scale and higher on the Brown- 
fain positive self-concept measure. 


Examination of the findings for the cross- 
validating group presented in Table 3 strongly 
supports the argument that the differences ob- 
served in the first sample did not arise as a 
function of chance. Thus, we note once again 
that the “high” negative self-concept group 
scores significantly higher on the Bills self- 
concept and self-acceptance scores, as well as 
on the Brownfain positive self-concept meas- 
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Table 2 


Differences between High and Low Negative Self-Concept 
Groups for First Sample 














Means Diff. 
Variable* High Low between tT pt 

(W537) (N17) means 
W. J. rigidity § 3.47 3.38 0.09 0.011 ns 
A. M. rigidity 3.37 4.43 1.06 1.070 ns 
Perceptual discrepancy 4.11 3.35 0.76 0.644 ns 
F scale 86.3 97.5 11.2 1.684 10 
Bills Col. I 194.0 171.5 22.5 4.047 001 
Bills Col. II 185.2 154.8 30.4 4.240 -001 
Bills Col. III 225.6 214.9 10.7 2.865 01 
Bills I-III 36.1 51.1 15.0 2.698 02 
Brownfain Pos. S. C. 216.8 206.7 10.1 1.834 .08 
Brownfain S. S. C. 47.6 94.4 46.8 6.316 .001 





*W. J. rigidity—number of rigid solutions for crucial 


problems in water-jar test series; A. M. rigidity — 


number of rigid solutions for crucial problems in alphabet-maze test series; Perceptual discrepancy — differenee 
between no. of trials required for correct report of eight neutral words and eight threat words under a threat 


expectancy condition; F scale 
self-concept, self-acceptance, 
fain Pos. 9.C. and S.S.C. 
negative discrepancy) scores. 


ideal self, 


— total score on California F scale; Bills Col. I, Col. II, Col. III, I-III — total Bills 
and maladjustment scores according to scoring system of Cowen; Brown- 
total Brownfain positive self-concept and stability of self-concept (summed positive- 


+F ratios testing homogeneity of variance were computed for all t's reported in Tables 2 and 3. In almost all in- 


stances the computed F value indicated approximate homogeneity of variance between groups. 
where heterogeneous variances were observed, the tabled t 


by Edwards [8]. 


In the few cases 
value is corrected according to the method suggested 


t Both tails of the t distribution were used in determining p values for Tables 2 and 3. 


§ the N’s vary slightly for the two rigidity measures as follows: 


W.J. rigidity—high 15, low 16; A.M. rigidity— 


High 15, Low 14, This is due to the fact that certain of these data were not scorabie. 


Table 3 


Differences between High and Low Negative Self-Concept 





Groups for Second Sample 








Means Diff. 
Variable* High Low between t p 
(N=—26) (N21) means 
F scale 82.2 98.5 16.3 2.690 01 
Theism 58.4 66.4 8.0 1.406 17 
Ethics 38.0 46.9 8.9 2.150 -05 
Bills Co'. I 191.8 180.7 11.1 2.478 .02 
Bills Col. II 182.5 165.0 17.5 2.946 01 
Bills Col. II 222.7 220.4 2.3 0.678 ns 
Bills I-III 35.3 46.0 10.7 2.709 01 
Brownfain Pos. S. C. 223.3 201.0 22.3 3.892 .001 
Brownfain S. S. C. 49.2 91.3 42.1 5.316 .001 





*Theism—strength of belief in God. 


Ethics—strength of reliance on the church for one’s ethical code. 
All other variables are used as noted in the corresponding footnote for Table 2. 


ure. The “high” group likewise scores signifi- 
cantly lower on the California F scale, and 
has significantly lower self-concept discrepancy 
scores for both the Bills Col. I-III discrepancy 
measure, and the Brownfain stability of self- 
concept index. On the two scales of religious 
attitude used for the first time with the second 


sample, the “high” negative self-concept group 
scores significantly lower than the low negative 
self-concept group on the Ethics scale, and 
tends to score lower on the Theism scale. 
Summarizing the performance of the high 
and low scorers on the negative self-concept 
measure for the two samples the following 





The “Negative Self Concept” as a Personality Measure 


generalizations are suggested : 


1. There are no differences between groups 
on measures of rigidity for either an arithmet- 
ical or verbal task. 


2. ‘There are no differences between groups 
with respect to differential perception of threat 
and neutral words in a “threat-expectancy” 
situation. 


3. ‘The high scorers have more positive con- 
cepts of self, and are more self-acceptant. 


4. The high scorers have narrower dis- 
crepancies between self-ratings made from dif- 
fering frames of references, and as such are 
presumably better adjusted insofar as these 
measures may be accepted as valid indices of 
adjustment. 


5. The high scorers are less predisposed to- 
ward authoritarian attitudes. 


6. In contrast to the low scorers, the high 
scorers tend not to have as strong a belief in 
the existence of God, and do not rely as 
strongly upon the church for an ethical code. 
This latter finding is proposed at a tentative 
level, and should be cross-validated on a new 
sample. 


Taken as a whole, these results seem to 
demonstrate a reasonably consistent set of per- 
sonality and sociopsychological correlates of 
verbalized responses on the negative self-con- 
cept measure.’ In the light of the generally 
equivocal findings noted in the studies based 
on indices of this type [8], the discriminatory 
power of the negative self-concept measure is 
almost surprising. 


That these positive findings may have gen- 
eralization value beyond the relatively super- 
ficial inventory devices employed as criteria in 
the present study is strongly suggested in the 
results of a recent parallel study by La Fon 
[10]. In his investigation, extreme high and 


7A structurally similar analysis to the one re- 
ported was done for extreme groups on the Brown- 
fain stability index and the Bills Col. I-III dis- 
crepancy (maladjustment) score. As might be ex- 
pected on the basis of the relatively high intercor- 
relations between these measures and the negative 
self concept noted earlier (See footnote 2), the direc- 
tion of the findings of these analyses is entirely con- 
sistent with the present analysis. Few of the differ- 
ences between extreme groups selected on the basis 
of the stability index, or Bills Col. I-III discrepancy 
were statistically significant, however. 
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low scores on the Brownfain negative self- 
concept measure were found to differ signifi- 
cantly on a series of Rorschach factors in a di- 
rection predicted on the basis of self-concept 
and Rorschach theory. La Fon found the nega- 
tive self-concept measure to be more discrimi- 
nating than the stability of self-concept index 
for which a similar analysis of Rorschach per- 
formance of extreme groups had been made. 

It is dificult to do more than speculate on 
the possible factors underlying the sensitivity 
of the negative self-concept measure which we 
have observed in our two samples.* Since we 
are dealing with a paper-and-pencil inventory, 
the usual directed toward 
measures must be considered, particularly that 
of falsification proneness. 


criticisms such 


It is conceivable that an S, when asked to 
make multiple ratings about himself as in the 
present study, may be inclined to relax his de- 
fenses more for an apparently innocuous rating 
such as the negative self concept than he would 
for the more traditional defense-mobilizing 
type of rating. ‘hus, the poorest rating that a 
person admits to on an inventory of this type 
may actually be the closest approximation to 
the way he actually feels about himself. If 
these speculations are at least partially correct, 
one might anticipate that a rating such as the 
negative self concept is potentially most mean- 
ingful and discriminating when embedded in 
the context of a series of other self-ratings. ‘To 
test the tenability of such an assumption the 
soundest general approach would seem to be 
that of studying negative self-concept ratings 
given under multiple and varied conditions of 
administration. Where this measure is given 
alone, its falsification proneness should in- 
crease, whereas when it is given as one of a 
series of ratings its falsification proneness 
should decrease. Significantly higher scores 
might therefore be expected in the “alone” as 


8It is quite probable that this sensitivity cannot 
be explained solely on the basis of the slight modi- 
fications of the Self-Rating Inventory used in the 
present study. Hauser [9] and La Fon [10], duy 
cating the original Brownfain technique almost pre 
cisely, found the private and negative self-concept 
measures to relate significantly to other personality 
indices, and to do so in a much more clear way 
than did the stability index. Hauser reports a corre 
lation of .78 between the private and negative self- 
concept measures. 
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compared to the “embedded” administration 
conditions. An experimental study of this hy- 
pothesis is now in progress. 


Summary 


Two samples of college undergraduates 
(N = 58 and 81 respectively) were given a 
modified Brownfain Self-Rating Inventory to- 
gether with several other personality and socio- 
psychological measures. On the basis of their 
responses to the Brownfain inventory, extreme 
groups of high and low scorers on the negative 
se]f-concept measure were selected, and the re- 
sponses of these groups on the dependent 
measures were contrasted. 

No differences between groups were ob- 
served on two tasks of problem-solving rigidity, 
or in perceptual reactivity to threat in a 
“threat-expectancy” situation. For all other 
measures, there were indications that the high 
negative self-concept group responded in a 
manner which was more indicative of good ad- 
justment than did the low negative self-con- 
cept scorers. Thus, the high scorers had more 
positive concepts of self and were more self- 
acceptant. They had smaller discrepancies be- 
tween self-ratings made from differing frames 
of reference, this presumably indicating a more 
stable self-picture and hence a better adjust- 
ment. They were less predisposed toward 
authoritarian attitudes. 

There were indications that the high scorers 
hold less intense religious beliefs, although the 
latter finding requires cross-checking. 

Some possible bases of the discriminatory 
power of the negative self-concept variable 
were considered, and suggestions for further 
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research were advanced. 
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Currently the two most popular individual 
tests for measuring intelligence in children 
are the Stanford-Binet and the Wechsler In- 
telligence Scale for Children [10]. The ad- 
ministration and scoring of these tests are rela- 
tively time consuming. Clinicians are there- 
fore always alert to the possibility of finding 
measures of intelligence which combine great- 
er brevity with a similar degree of validity. 

One of the most promising of the shorter 
tests appears to be Raven’s Colored Progres- 
sive Matrices [7]. This test is derived from, 
and represents an elaboration of, Raven's Pro- 
gressive Matrices [5]. The “matrix” tests 
have their rationale in Spearman’s cognitive 
principles [8]. Spearman thought that in order 
to act intelligently in any situation, the indi- 
vidual required on the one hand the necessary 
information and on the other hand the intellec- 
tual capacity to apprehend the situation and 
draw inferences from what he perceived. 

The individual’s fund of information and 
range of ideas can be assessed by a vocabulary 
test [9, p. 99]. His capacity to form compar- 
isons and reason by analogy can be assessed, in- 
dependently of verbal skills, by showing him a 
series of simple geometric figures and asking 
him to complete the patterns of relations that 
they convey [4]. The latter is effected in the 
matrix type of test in which the subject is 
shown a series of patterns with parts removed. 


1Appreciation is expressed to Dr. Harry Yama- 
guchi of the Indiana University Psychological Clin- 
ic and to the Riley Child Guidance Center, Indian- 
apolis, for the facilities so generously offered. We 
wish to thank the graduate students who assisted 
with the testing and Dr. John Conger of the Med- 
ical Center, Indianapolis, for his kind advice and 
helpful criticism. 
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These parts are of simple shape and are placed 
among other pieces of similar shape with fig- 
ures on them that do not complete the pat- 
terns. As the test proceeds, the problems be- 
come more difficult, because the figures in the 
patterns to be completed remain simple but 
the relations between the figures become in- 
creasingly complex. By using a standard series 
of problems of this kind it is possible to assess 
the individual’s present output of intellectual 
activity [1]. In booklet form, the Matrices 
can be employed as an individual test, a self- 
administered test, or a group test [6]. 

Colored Progressive Matrices consists of 
three series of matrix designs, twelve in each 
series. To attract and hold the attention of 
children, each matrix is printed on a separate 
page against a brightly colored background. 
The child’s score is the total number of mat- 
rices correctly completed. Instructions for ad- 
ministration and scoring are given elsewhere 
[7]. 

Unlike the Stanford-Binet and the WISC, 
the Matrices test reduces the influence of 
schooling and motor handicaps to a minimum. 
Progressive Matrices has already been shown 
to correlate highly with both the Wechsler- 
Bellevue [3] and Stanford-Binet [5]. In view 
of the popularity of the WISC and the po- 
tential clinical usefulness of the Colored Pro- 
gressive Matrices, it seemed worth while to in- 
vestigate systematically the extent to which 
WISC scores compared with performance on 
the other test. The present paper reports the 
results of such an investigation. 


Subjects and Procedure 
One hundred Indiana school children be- 
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tween their ninth and tenth birthdays were ad- 
ministered the Colored Progressive Matrices 
and the WISC. The sample consisted of 60 
boys and 40 girls representing four schools. 
Each test was given individually, half the group 
being administered the WISC first and half the 
Matrices first. Both the tests were adminis- 
tered at the same session, each examiner al- 
ternating his order of presentation. The ex- 
aminers were seven graduate students in psy- 
chology from Indiana University, each of 
whom had previously demonstrated compe- 
tence in the administration and scoring of both 
tests. 


Results 


Scores ranged from 8 to 35 on the Colored 
Matrices test with a mean of 25.3 and 
standard deviation of 6.5. On the WISC Full 
Scale IQ, scores ranged from 74 to 141, with 
a mean of 107 and standard deviation of 


16.1. 


Table 1 


Intercorrelations among Colored Progressive 
Matrices and WISC Scores for 100 











Children 

WISC measure . 
Full Scale IQ 91 
Verbal IQ 84 
Performance IQ 83 
Block Design .74 
Object Assembly 73 
Vocabulary 73 
Comprehension -70 
Arithmetic -66 
Picture Completion 62 
Similarities 62 
Coding .60 
Picture Arrangement 58 
Information 47 





The correlations between the Matrices 
scores and WISC IQ’s and weighted subtest 
scores are presented in Table 1. It can be in- 
ferred that the Matrices score and the WISC 
Full Scale IQ are measuring to a considerable 
extent the same factors. The coefficient of de- 
termination for the correlation of .91 indicates 
that 82.81 per cent of the variance in the 
WISC Full Scale IQ distribution is associated 


with the variance in Matrices score distribu- 
tion. 

It is interesting to note that the Full Scale 
IQ correlation obtained here compares favor- 
ably with the correlation between the Stan- 
ford-Binet and WISC obtained with subjects 


of comparable age [2]}. 


Summary and Conclusions 


Raven’s Colored Progressive Matrices and 
the WISC were administered to 100 school 
children between nine and ten years of age. 

Correlations of .91, .84, and .83 were ob- 
tained between the Matrices score and WISC 
Full Scale, Verbal, and Performance 1Q’s. 

In view of these high correlations and the 
ease and speed of administration, it would 
seem that the Colored Progressive Matrices 
will find more extensive use in the clinical 
testing of children. 


Received July 17, 1953. 
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The gambling problem in the United States 
has of late aroused a great deal of interest. 
While considerable effort has been expended 
to control gambling behavior, there have been 
relatively few attempts to discover its psycho- 
logical basis. Psychoanalytic writings con- 
cerned with neurotic cases of gambling have 
been highly idiographic. On the other hand, a 
few experimental studies have used psychomet- 
ric methods on larger samples, but have been 
mostly limited to college students in very arti- 
ficial gambling situations. 

The study described in this paper attempts 
to bridge the gap between these two approaches. 
It had for subjects 31 women who spend a 
substantial portion of their time playing poker 


in commercial card clubs. The hypothesis in- 


vestigated was as follows: The gambler is 
usually an emotionally insecure individual with 
a strong tendency to: believe in the importance 
of luck. The hypothesis is in accord with the 
theories of several psychoanalysts [1, 4] per- 
taining to the basis of gambling behavior. They 
think of gambling as an effort on the part of 
the gambler to receive an answer or reassur- 
ance with respect to various conflicts. The 
reasoning is that the result of the gamble 
gives an answer, i.e., winning represents a 
favorable answer or acceptance, and losing, 
an unfavorable one or rejectance. The habitual 
gambler is driven again and again to seek the 
answer to his conflict in terms of gambling. 
From this line of reasoning, one would expect 
the gambler to be an emotionally insecure per- 
son. Many people are insecure however, but 
probably only a small percentage of them 
gamble. We may further hypothesize that only 
those insecure people who have a rather strong 

1This paper is based on a thesis submitted to the 
Graduate School of the University of Southern Cal- 


ifornia in April, 1953, as partial fulfillment of the 
requirements for the degree of Master of Arts. 


tendency to believe in luck, and have, in gen- 
eral, a subjective attitude toward life, find 
gambling a solution for their insecurity. 

To test the hypothesis, three aspects of be- 
havior need to be measured: (a) willingness 
to gamble or take risks; (4) emotional inse- 
curity; and (c) subjective beliefs, particularly 
superstitions and belief in luck. If the hy- 
pothesis is to be verified, we would expect to 
find positive correlations among these three 
measures. 


Subjects and Location of Study? 


The subjects were chosen from the commer- 
cial card clubs of Gardena and Seal Beach, 
California. These clubs are legal in California, 
and are open to the public. Six of them oper- 
ate in Gardena and one in Seal Beach. They 
contain from 30 to 35 tables per club, each 
table seating eight players. The Gardena clubs 
are open from 10 a.m. until 4 a.m. the fol- 
lowing morning, for a total of 18 hours, seven 
days a week. Four of them have been in un- 
interrupted operation for more than ten years. 
The club in Seal Beach operates 24 hours a 
day. 

Only two varieties of five-card draw poker 
are played in these clubs: high draw poker, in 
which the best high hand wins, and low-ball 
draw poker, in which the best low hand wins. 
The games are all of the limit varietv, i.e., 
only a specified amount can be bet both before 
and after the draw. They range from 50 cents 
and one dollar (50 cent limit before the draw 
and one dollar afterward) to as high as 40- 
dollar straight games in which the limit is 40 
dollars both before and after the draw. When 


a player sits in a particular game, he is re- 


2The writer wishes to express his thanks to Miss 
Cecile Tipton for her valuable aid in securing sub- 
jects for this study. 


145 





146 


quired to buy checks (chips) whose total value 
is ten times the limit of the bet before the 
draw. For instance, in a two- and four-dollar 
limit game, the ‘“‘buy-in’”’ is 20 dollars. 

There is no house player or dealer in these 
games, and no cut is taken from the money 
wagered. The club collects an hourly fee from 
each player, depending on the size of the game. 
This fee ranges from 50 cents an hour in the 
smallest games to three dollars an hour in the 
largest. 

The players average about 65 per cent men 
and 35 per cent women. Only women were 
used in this study. The 31 women were chosen 
as randomly as possible. ‘They were asked to 
fill out the inventory when they were not play- 
ing, usually when they were waiting for a seat 
in a game. A few refused, either because they 
did not have time or did not want to be 
bothered. The inventory, which required about 
45 minutes to complete, was filled out in the 
clubs. With the exception of three subjects, the 
women gave their time free of charge. 


The age range of the subjects was from 25 
to 54 years, with a mean of 37 years. These 
women have been playing in the poker clubs for 
from 2 to 12 years, with a mean cf 6 years. 
They were asked to estimate the number of 
times per week they had played for the past 
year. The mean for the group was 2.7 times 
per week. The average number of hours played 
at a time was about five. One of the questions 
in the inventory asked for the longest session 
played at one time. The answers ranged from 
4 to 48 hours, with a mean of 22.3 hours. The 
13 individuals indicating more than 18 hours 
at a time apparently had played at Seal Beach, 
where the club is open 24 hours a day. It is 
clearly seen that the subjects in this sample 
spend a substantial portion of their time in a 
gambling activity. No other claim is made 
about the sample. 


The Inventory 


In giving the inventory, it was always 
stressed that (a) information would remain 
anonymous; (4) names were not to appear on 
the forms at any place; and (c) information 
gathered was to be used concerning the group 
and not individually. Only a bare minimum of 
information was given the subjects concerning 
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the purpose of the study. The inventory was 
made up of four sections as follows: 


1. A personal questionnaire containing 17 items, 
largely about past gambling behavior. The most 
important gave information about (a) the 
frequency of playing poker during the past year in 
the above-mentioned clubs, and () their estimate of 
the percentage of days played on which they won. 
It was not possible to get estimates of amounts of 
money won or lost. 


items 


2. The second portion of the inventory was a 
poker test. The purpose of this test was to measure 
the extent to which the subjects were willing to 
take chances or gamble in the poker game. In order 
to test the hypothesis that gambling is a result of in- 
security, it is necessary to measure this gambling 
behavior. 

We must pause here to draw a distinction be- 
tween the roles that skill and gambling play in the 
game of poker. The outcomes of some gambling 
games, such as roulette or dice, depend entirely on 
chance; while others, such as bridge or poker, are 
directly related to the skill of the players as well 
as to chance. Griffith writes: “The briefest perusal 
reveals that not all forms of gambling are psy- 
chologically equivalent. Games of chance may be 
placed in a hierarchy of skills. The conative predic- 
tions of the fall of dice contrast with the cognitive 
factors involved in skillful poker-playing” [2, p.291]. 
The more a game depends on chance, the more it 
is a pure gamble; while the more it depends on skill, 
the more it resembles a sport or business. The pro- 
fessional, or percentage, poker player relies to a 
large extent on his ability to value correctly the 
hand so that when wagering money he can be as- 
sured that the probabilities of winning are good. 
Other poker players consistently risk money on 
hands where the probability of winning is quite 
small. It is clear that the latter are gambling more 
than the former. The amount a person gambles is 
more accurately measured by the manner in which 
he plays rather than the frequency of playing. 


It is impossible to describe clearly the poker test 
used in this study without first describing the rules 
of the game. Since space does not permit this, a de- 
scription of what it purports to measure will have 
to suffice. The subjects were given 30 poker hands 
in clearly described situations. All the information 
that they have in the actual game was given them. 
They were asked to mark how they would play the 
hand in the game. They were urged to mark it as 
they would play it in the actual game, and not how 
they felt it should be played for percentage or 
other reasons. The 30 situations were made up of 
(a) five hands which it was felt even the most con- 
servative players would play; (+) five hands which 
would be regarded as extremely poor risks by vir- 
tually all players; and (c) 20 hands that were con- 
troversial in the sense that some players feel they 
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are good enough to play, while other, more con- 
servative players, do not usually play them. The 
test was scored by giving one point to each hand 
that was played, and zero to each hand that was 
passed. Thus, a high score indicated a tendency to 
take considerable risk in the game, while a low 
score indicated a conservative player. 

3. The third section of the inventory is called a 
luck test, and purports to measure subjectivity of 
the subject, particularly pertaining to the poker 
game. It was designed to test that part of the hy- 
pothesis that describes the gambler as having a 
strong tendency to believe in luck or fate. It is 
composed of 39 short questions pertaining to super- 
stitions about playing poker. Wherever possible, the 
questions are phrased in an objective, unambiguous 
manner, such as “do you carry a good luck piece?” 
or “do you often change into the seat at a poker 
table previously occupied by a big winner?” Some 
of the questions were of a more general nature, 
such as “do you believe what is to be, will be?” 
The test was scored, giving one point to each answer 
indicating a subjective attitude. 

4. The fourth section was the adult form of the 
Bell Adjustment Inventory. It is composed of 160 
questions, and gives scores on home, social, job, 
health, and emotional adjustment. Since many of 
the subjects in this study were housewives, no tabu- 
lating was made of job adjustment. The Bell in- 
ventory was used to get a measure of adjustment, 
particularly emotional adjustment, that could be 
correlated with the earlier tests of willingness to 
take risks and belief in luck or superstition. A 
second reason for administering the Bell inventory 
was to compare the scores of the women poker 
players with the norms for women for this test. A 
high score on the Bell inventory indicates poor ad- 
justment in the particular field, and in order to 
avoid confusion, the scores will be referred to as 
maladjustment scores in the remainder of this paper. 


Results 


Adjustment of women poker players com- 
pared to that of the general population. The 
mean maladjustment scores on the Bell Ad- 
justment Inventory for the 31 women poker 
players were compared with the mean for 274 
women on which the norms for the test have 


been based. ‘The results are presented in Table 
‘ 


If we are to take the results of the Bell in- 
ventory as a valid indication of adjustment, 
the women used in this study are significantly 
better adjusted, on the average, than are the 
female adults of the general population. This 
applies to the section on emotional, home, and 
social adjustment. The health adjustment 
mean is virtually the same for the two groups. 


‘Table 1 
Adjustment of Women Poker Players versus That 
for the General Population 


Mean 
Section poker Mean Sigma 
pl'rs norm Diff. diff. t 





Emotional 7.26 11.00 3.74 1.48 2.53* 
Home 5.48 8.26 2.7 140 1,99* 
Health 6.87 6.18 69 1.28 .54 
Social 9.06 14.12 5.06 1.42 3.56** 
Total score 28.68 35.84 7.16 4.51 1.59 





Note.—High scores on the Bell Adjustment Inventory 
indicate poor adjustment. 


* Significant at the 5% level of confidence. 
** Significant at the 1% level of confidence. 

It is not surprising to find that women who 
play cards in commercial card clubs are rela- 
tively socially aggressive. On the other hand, 
we might predict for a priori reasons that wo- 
men who spend so much of their time gambling 
are likely to have poor home and emotional ad- 
justment. It is certainly true that some indi- 
viduals are forced to undergo financial hard- 
ships and sometimes marital conflict as a result 
of their gambling. It might also be argued, a 
priori, that well-adjusted women would stay 
within the limits of the more traditional fe- 
male pursuits, and habitual gambling would 
only prove attractive to personality misfits. On 
the other hand, if playing poker can be classi- 
fied as a hobby, it is quite possible that it may 
contribute to good adjustment by combating 
boredom. In our society, many middle-aged 
women find that time weighs heavily on their 
hands, and the resulting borelom is often a 
contributing factor to conflicts in various 
facets of their lives. ‘Io the extent that the 
game of poker offers a stimulating activity to 
occupy the participant’s time and interest, it 
may well be an adjustive factor. It will be re- 
called that several of the women in this study 
indicated that they had played poker for more 
than 24 hours at a single session. An activity 
that can maintain interest for such long periods 
of time is certainly a ‘ 
for these individuals. 


‘stimulating activity”’ 


Luck test versus emotional maladjustment. 
The correlation between these two scores was 
a positive .53, which is significant beyond the 
1 per cent level of confidence. This supports 
the hypothesis that emotionally insecure per- 
sons who gamble a great deal will put a heavy 
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emphasis on belief in luck, superstition, and 
predictions concerning the future. It is inter- 
esting to note that Maller and Lundeen [3] 
found a similar relation between emotional in- 
security and common superstitions in seventh- 
grade children. 

Emotional maladjustment versus poker test. 
According to the hypothesis, we would predict 
a positive correlation between these two scores. 
Persons who are more insecure would tend to 
emphasize luck and the gambling side of poker, 
playing more hands in the poker test, i.e., tak- 
ing more chances or gambles. The correlation 
we find is in the expected direction (.14), but 
is not significant, and could have easily arisen 
by chance. Apparently those players evidencing 
emotional insecurity do not take more chances 
in the poker game than their better adjusted 
companions. 


Luck test versus poker test. The correlation 
found here was —.04. There is no evidence 
that the more subjective players take more 
chances in the poker game than do the more ob- 
jective ones. 

Luck test versus percentage of wins. In the 
first section of the inventory, information was 
obtained concerning the percentage of the days 
played on which the subject estimated she 
won. The range was from 10 to 60 per cent. 
The mean estimate was 28.5 per cent, with 
seven of the 31 women checking the category 
of 10 per cent or less. Six subjects estimated 
they won 50 per cent or more of the times 
played. It is not unreasonable that a few 
players win more often than they lose for, as 
stated above, the games are between the cus- 
tomers rather than against the house, the latter 
only collecting a small fee from each player. 
We might expect the superstitious person to 
play more according to irrational hunches and 
to be less successful than the more objective 
player, resulting in a negative correlation be- 
tween the luck or superstition test and the es- 
timate of percentage of wins. Actually, we find 
a small, insignificant, positive correlation of .12 
between them. 

Other correlations were: .14 between fre- 
quency of playing and belief in luck or super- 
stition ; .02 between frequency of playing and 
emotional maladjustment; and .18 between 
frequency of playing and estimate of percent- 
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Table 2 


Correlation Coefficients between Inventory 
Test Scores 








Inventory section 








Correlation 





Luck test vs. emotional maladjustment .527** 
Luck test vs. total maladjustment .393* 
Luck test vs. poker hands —.036 
Luck test vs. percentage of wins 116 
Luck test vs. home maladjustment .376* 
Luck test vs. health maladjustment 005 
Luck test vs. social maladjustment 336 
Luck test vs. plays per week .144 
Poker hands vs, percentage of wins 194 
Emotional maladjustment vs. 

poker hands 143 
Emotional maladjustment vs 

percentage of wins 261 
Emotional maladjustment vs. 

plays per week 021 
Percentage of wins vs. plays per week  .180 
Plays per week vs. 

home maladjustment -168 





* Significant at the 5% level of confidence. 


** Significant at the 1% level of confidence. 

age of wins. Table 2 gives a complete list of 
the correlations found between the various 
scores. 


Discussion 


For the most part, the results did not sub- 
stantiate the hypothesis connecting emotional 
insecurity and belief in luck with gambling. 
The only supporting evidence was a rather 
well-established relation between emotional in- 
security and belief in luck and superstitions. It 
is of interest to note that persons who showed 
a higher than average belief in superstitions 
and luck did not appear to let their beliefs 
cause their actual play to deviate from that 
prescribed by a more objective attitude based 
on probabilities. They neither took more risks 
in the poker test, nor did they estimate a higher 
percentage of losses in the actual game than 
the more objective players. Apparently, they 
did not place any unusual demands on their 
“luck” and superstitious beliefs. 

We have not succeeded in establishing any 
clear psychological cause for gambling behav- 
ior, but neither can we accept the simple ex- 
planation that the gambler is merely seeking 
an easy way to make money. It will be recalled 
that 7 of the 31 subjects estimated they won 
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only 10 per cent or less of the days played. 
When we consider that these seven players 
have averaged playing about 2.7 times per 
week for the past several years, it is difficult 
to understand how they could have any ex- 
pectation of making easy money by gambling. 
Most of the women (25 out of the 31) of this 
study readily admit that they lose more than 
50 per cent of the time, and have been doing 
so for a number of years. Some human activi- 
ties are sustained for long periods of time with 
very infrequent reinforcement; but if winning 
10 per cent of the time represents the rein- 
forcement that sustains gambling behavior, 
then winning is valuable in some way other 
than the actual value of the money. It would 
appear that no amount of rationalizatior can 
make such a person think that she is making 
or can make money at this activity. 

The superior Bell Adjustment Inventory 
scores that were found for a sample of women 
poker players may be in part due to the all- 
consuming nature of the game for these per- 
sons. Poker playing has an important role in 
their lives, and consumes a great deal of their 
time; 11 of the subjects indicated they had 
played over 24 hours at a single session. When 
a person is voluntarily immersed in an activity 
which she finds very stimulating and absorb- 
ing, whether it is a job, bridge, golf, or poker, 
such that she wishes to spend all or a large 
portion of her available time in this manner, 
it is not surprising to find that this person 
shows a minimum of worries, is not irritated 
by the people in the home, and in general, 
answers questions that make up the Bell Ad- 
justment Inventory in a favorable manner. 
The game of poker, like other games, can be 
classified as an escape from reality, and per- 
sons who play as much as do the subjects in 
this study may be said to be using it in an ex- 
treme manner, rather than practicing modera- 
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tion. In addition, such frequent playing is 
likely to cause financial hardships in some in- 
stances. Nevertheless, the subjects in this study 
appear to have achieved a satisfactory adjust- 
ment, at least as measured by an adjustment 
inventory. 


Summary 

1. ‘Lhe group of women poker players ex- 
amined in this study received significantly bet- 
ter adjustment scores on the social, home, and 
emotional sections of the Bell Adjustment In- 
ventory than did the group of women on which 
norms for the general population were ob- 
tained. 

2. Women in the sample who received poor 
scores on the emotional adjustment section 
tended also to believe in luck and superstitions 
rather strongly. The correlation was signifi- 
cant beyond the 1 per cent level. 

3. Emotionally insecure individuals did not 
take more risks in the gambling situation, or 
tend to lose more often, than did persons evi- 
dencing better adjustment. 

4. Persons scoring high on the luck or su- 
perstitions test did not tend to take more risks 
in the poker game or lose more often than did 
the more rational subjects. 


Received June 16, 1953. 
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A Correction 


Several errors of omission occurred in the 
article “An Ego Strength Scale Which Pre- 
dicts Response to Psychotherapy” (J. consult. 
Psychol., 1953, 17, 327-333). On page 
328, column 1, line 57, the sentence “62. Parts 
of my body often have feel:ngs like burning, 
tingling, crawling, or like ‘going to sleep’.”’ 
should read “62. Parts of my body often have 
feelings like burning, tingling, crawling, or 
like ‘going to sleep’ (F).” Also on page 328, 
column 2, line 1, the sentence which reads “My 
plans have frequently seemed so full of diffi- 
culties that I have had to give them up (F).” 


should read “389. My plans have frequently 
seemed so full of difficulties that I have had 
to give them up (F).” 

In addition, only 66 of the 68 items of the 
Ego-strength scale were listed. The two items 
inadvertently omitted are: “515. In my home 
we have always had the ordinary necessities 
(such as enough food, clothing, etc.) (T).” 
and “43. My sleep is fitful and disturbed (F).” 


— Frank Barron. 


Received December 19, 1953. 
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Books 


Abrahams, Joseph, & Varon, Edith. Maternal de- 
pendency and schizophrenia. New York: Inter- 
national Universities Press, 1953. Pp. 240. $4.00. 


There are many aspects of this book which will 
make it widely read and, one hopes, widely emu- 
lated. The volume is an account of a group thera- 
peutic experience involving seven schizophrenic 
daughters and their mothers, a psychiatrist, and a 
research psychiatric social worker, interacting in the 
natural visiting room situation of St. Elizabths 
Hospital. The account is outstanding for its candor 
and its realistic humility, but equally noteworthy for 
its careful and responsible reporting of events as 
they occurred. In one sense, the investigation makes 
its most significant contribution in its handling of 
methodological problems. The techniques of record- 
ing sessions, of drawing inferences from behavior, 
and of dealing with the anxieties and concerns of the 
professional investigators, constitute in themselves 
a valuable addition to the research tools in this 
complex and difficult area. In another and equally 
important sense, however, the study provides in- 
formation concerning the dynamics of schizophrenic 
disorder in young adult women—particularly as it 
points up maternal dependency on the daughters’ 
continuing illness, and the daughters’ reciprocal de- 
pendency on the mothers, interrupted only occa- 
sionally by bizarre and distorted efforts at rebel- 
lion. In still another sense, the study offers hints as 
to the stresses and rewards awaiting the therapist 
who chooses to work with this most difficult clinical 
group. Any student of personality or group process, 
whether he studies normal or pathological behavior, 
will profit from reading and rereading this book. 
—A. M. G. 


Cantor, Nathaniel. The teaching-learning process. 
New York: Dryden, 1953. Pp. ix + 350. $2.90. 


The author presents the ideas and practices of 
personalized or pupil-centered education by inter- 
polating throughout the book verbatim reports of 
teaching-training seminars which use the method 
he advocates. The book begins with the prevailing 





Note.—The reviews were prepared by the Editor 
and Associate Editors, who may be identified by 
their initials. 
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STS 


illustrated by 


teaching, 


orientation in American 


topics such as the “authoritarian classroom,” 
“avoiding challenge,” “teacher requires—pupi! re 
peats.” It moves to a discussion of conditions and 


attitudes planned to reach the author’s aims of the 
teaching-learning process, namely, improved self- 
understanding and human relationships. The 
phasis is on the reality-centered school which 
strikes a balance between the needs of the child and 
those of the community. The use of the book should 
lead to a much greater understanding of psych 
dynamics and of with a 
minimum acquisition of technical terms. It seem 
excellently suited to typical classes for teachers 


—F. McK. 


em- 


interpersonal relations 


Freud, Sigmund. On aphasia. Trans. by E. Stengel 
New York: International Universities Press, 1953 
Pp. xv + 105. $3.00. 


Freud’s monograph on aphasia, first published in 
German in 1891 and unavailable for many years, 
has been translated into English for the first time. 
It belongs to his preanalytic period, antedating the 
earliest works in the Collected Papers, but is by no 
means only a historical curiosity. Freud’s 
abilities of observation and induction are attested 
by his conclusions on aphasia, closer to modern 
views than to those of his contemporaries. The be- 
ginnings of his interest in functional psychology 
may be found in his analysis of word concepts and 
in his citation of Hughlings Jackson’s doctrine of 
functional retrogression. Freud’s later disposition « 
formulate a sweeping theory from a single case is 
also forecast, and is seen in its historical setting as 
a method common among nineteenth century nevu- 
rologists.—L. F. S. 


keen 


Ginzberg, Eli, Herma, John L., & Ginsburg, Sol W. 
Psychiatry and military manpower policy. New 
York: Columbia Univer. Press, 1953. Pp. xi + 
66. $2.00. 


This minor contribution is overly dignified by 
publication in book form. Some 53 psychiatrists 
were approached by letter and questioned concern- 
ing their opinions on military psychiatry and man- 
power. “Almost all of the psychiatrists responded,” 
but not all the materials were used. The principles 
governing the selection of material are not clearly 
stated. The points made are timely, but all are more 
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fully developed elsewhere in the literature, where 
they are often reinforced by statistical and experi- 
mental evidence. It is a shame that the authors 
found that “the scientific literature is much too vast 
to have been reviewed in detail,” and somewhat 
suggestive that before the material was gathered 
“we had already developed a tentative research 
plan which incorporated these points."—W. d. H. 


Hovland, Carl I., Janis, Irving L., & Kelley, Harold 
H. Communication and persuasion. New Haven: 
Yale Univer. Press, 1953. Pp. xii + 315. $4.50. 


‘his book represents one of the first comprehen- 
sive and systematic attempts to investigate the sym- 
bolic environment which to such a large extent de- 
termines human thought and action. Giving rela- 
tively little attention to the purely linguistic aspects 
of the communication process, Hovland and his as- 
sociates concern themselves with such problem areas 
as the factors affecting the credibility of the com- 
municator, the dynamics of fear-arousing appeals, 
the structure of persuasive arguments, the relation- 
ship of personality and group membership to one’s 
receptivity or resistance to persuasion, and the de- 
gree of stability in opinion changes affected through 
persuasive communications. Such issues have strik- 
ing relevance for clinical psychologists, who work 
almost exclusively with symbolic techniques and 
whose job is to understand and to alter behavior by 
means of verbal tools. These clinical implications, 
while only in the background of the present work, 
are nevertheless quite explicit, and the authors 
promise future work dealing directly with the com- 
munication psychotherapy and other 
clinical situations. Meanwhile, clinicians can learn 
much from this work. Benefiting from its sugges- 
tiveness and insights, they may even be able to con- 
tribute significantly to the advancement of the 
fruitful studies described in it. Drawing on an im- 
pressively wide range of information and ideas, as 
well as reporting a wealth of new and ingenious 
investigations, Communication and Persuasion, 
among its other accomplishments, illustrates nicely 
how a psychological theory (in this case, Hull’s) 
can be usefully modified and broadened by being 
put to new tasks, and how it can be employed as a 
device for discovering new and relevant know- 
ledge and principles rather than as a doctrine to be 
defended.—E. J. S§. 


process in 


Ingram, Christine P. Education of the slow-learning 
child. New York: Ronald, 1953. Pp. ix + 359. 
$5.00. 


Education of the Slow-learning Child is an ex- 
cellent book for all those interested in the education 
and training of retarded pupils. While the book is 
a second edition, its bibliography and text have 
been completely rechecked. In areas of rapid and 
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significant changes, the book has been reorganized 
and the content rewritten to meet present situations. 
It should prove very helpful as a textbook in the 
courses for the training of teachers of slow-learning 
pupils.—B. M, L. 


Loewenstein, Rudolph M. (Ed.) Drives, affects, be- 
havior. York: International Universities 
Press, 1953. Pp. 399. $7.50. 


New 


['wenty-three different writers contributed to this 
series of essays on psychoanalysis, published in hon- 
or of Marie Bonaparte. The papers fall into three 
categories: those dealing with psychoanalytic theory, 
those making clinical contributions, and those con- 
cerned with applied psychoanalysis. The contribu- 
tions are sufficiently varied—both in content and in 
viewpoint—to ensure any reader’s being stimulated 
by some and irritated by others. Probably most gen- 
erally appealing to psychologists will be the highly 
sophisticated essay on the function of theory in psy- 
choanalysis by Hartmann, Kris, and Loewenstein, 
the analysis of affects in relation to psychic dis- 
charge Edith Jacobson, and Anna 
Freud’s beautifully lucid statement on the relation- 
ship of psychoanalytic instinct theory to human be- 
havior, originally prepared as a lecture for Unesco. 
Singling out these essays for special mention, how- 
ever, should not obscure the importance of the case 
materials, anthropological studies, and contributions 
to ego and libido theory which are also included in 
this significant volume—A. M. G. 


processes by 


Nichtenhauser, Adolf, Coleman, Marie L., & Ruhe, 
David S. Films in psychiatry, psychology and 
health, New York: Health Education 
953. Pp. 269. $6.00. 


mental 
Council, 


The authors of this book are very modest. They 
describe the book as “a catalogue and study of rep- 
resentative films, intended to encourage the appro- 
priate use of films in psychiatry, psychology, and 
mental health.” It is much more than that. It con- 
tains excellent discussions of the use of films in psy- 
chological and related fields, of problems in re- 
viewing films, of the use of films in the teaching 
of neurology, psychiatry, psychology, and mental 
hygiene, and of the history of film development in 
these fields during the past fifty years. The bulk of 
the volume is devoted to detailed reviews of fifty- 
one of the most important films in psychiatry, psy- 
chology, and mental hygiene. These reviews are so 
thoroughly done by selected reviewing panels that 
they serve as excellent guides for the use, rental, or 
purchase of the films, and minimize the burden of 
seeing in advance films that are clearly unsuitable. 
Fifty other films in the same fields are listed with 
brief annotations. This book will probably be a 
standard work for years to come.—M. K. 
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Notcutt, Bernard. The psychology of personality. 
New York: Philosophical Library, 1953. Pp. i + 
249. $4.75. 


This rather short book would not serve as a text 
in theories of the psychology of personality, nor is it 
intended as such. But I know of no other book 
which views the subject with such common sense, 
or presents such a neat distillation of the essence 
of various views of personality. The book is writ- 
ten witb extraordinary clarity, and with a most un- 
usual combination of genuine appreciation and no- 
table lack of awe. It should be helpful to students 
bogged down in a morass of details, and to lay- 
men or other scientists interested in the field.—A. R. 


Schilder, Paul. Medical psychology. Trans. by 
David Rapaport. New York: International Uni- 
versities Press, 1953. Pp. 428. $7.50. 


Schilder’s pioneering work of 1923 sought to com- 
bine psychoanalysis and experimental psychology, 
brought phenomenology into contact with psycho- 
pathology, and paid considerable attention to ego 
psychology. All of these trends have been amplified 
in subsequent years, and Schilder’s early contribu- 
tions are revealed as important ones. Rapaport’s 
part in the present volume exceeds that of a mere 
translator. He is also an editor and commentator, 
contributing a foreword, an appended essay in ap- 
preciation of Schilder’s contributions to the theory 
of thought processes, and hundreds of footnotes 
which clarify the text and trace many sources of 
the author’s concepts. The scholarly volume will be 
read with satisfaction by psychologists who have ad- 
mired Schilder’s later and better-known writings. 


—L. F. §. 


Stolurow, Lawrence M. (Ed.) Readings in learning. 
New York: Prentice-Hall, 1953. Pp. viii + 555. 
$6.00. 


In this publication Stolurow has selected 39 im- 
portant papers in the field of learning and, with a 
minimum of editing, has assembled them under 
eight major topics. Most of the articles have ap- 
peared since 1940, and eleven of the 39 are con- 
tributed by five authors. Spence, who contributed 
three articles, leads the list. Although both theoret- 
ical and research articles are included, the theo- 
retical articles are, for the most part, presented 
early in the edited series. In general, the studies 
are concerned with human subjects and employ 
stimulus-response conceptualizations. The author 
hopes that the volume will contribute to the teach- 
ing of learning (as a science) by training the stu- 
dent to read the periodical literature critically, with 
an awareness of the problems and procedures in- 
volved in conducting and reporting research. The 
author suggests that the volume could also serve 
as a laboratory text. The level of training at which 
this material is considered to be applicable is not 


indicated, however, and one cannot tell whether 
the author prepared the material for undergraduates 
in general, for advanced undergraduate majors, or 
for graduate students. Although all of the articles 
are important in the field of learning, many of them 
are highly technical in nature and, in the opinion 
of this reviewer, intelligible only to interested grad 
uate students. —J. R. W. 


Vernon, Philip E. Personality tests and assessments 
London: Methuen, and New York: British Book 
Centre, 1953. Pp. xi + 220. $4.00. 
Vernon has produced a compact but impressively 

comprehensive survey of all methods used for the 

appraisal of personality: interviews, physical signs, 
expressive movements, tests, ratings, questionnaires, 
and projective techniques. His discussion is based 
mainly on research findings; almost every page cites 
relevant evidence to support his conclusions. Ameri 
can research studies are sampled wisely and refer 


, 
' 


ences are made to numerous useful British studies 
which probably are less well known to American 
readers. Personality theory is given a subordinate 


role, represented only by an able limited ir 


troductory chapter. Emphasis is placed on the use 
of assessments for educationa! and vocational selec 
tion in which criteria are available to permit the 
determination of validities. Measurement for clini- 
cal description is regarded as a “most intractable 
problem” because of the absence of appropriate ex- 
ternal criteria. With its merits of thoroughness and 


unprejudiced objectivity, Vernon’s | should find 
wide use as a text. Our students should be ac 


quainted with it.—L. F. §. 


Tests 
Brown, William F., & Holtzman, W e H. Brown- 
Holtzman Survey of Study Habits and Attitudes 
College freshmen. 1 form, Untimed, (20) min. 
Question booklets ($2.00 per 25); IBM answer 
sheets ($1.85 per 50); manual, pp. 8, and keys 
(50¢); specimen set (60¢). New York: Psycho- 


logical Corp., 1953. 


The most distinctive characteristic of this study 
habits inventory is its emphasis on the attitudes 
which facilitate effective study as well as on skills 
The items were developed through a series of em- 
pirical trials which identified characteristics of high 
achieving and low-achieving students of matched 
ability. The empirical process showed the need for 
separate keys for men and women students. Split- 
third reliabilities of the two keys are .92 and .84. 
For 1,349 men in five colleges, the average correla- 
tion of the Survey with grades was .41 and with 
the ACE, .25. The multiple correlation of the Sur- 
vey and the ACE with grades was .57, in compari- 
son with .47 for the ACE alone. The Survey is 
recommended for diagnosis, remedial teaching, and 
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research, and is not regarded as suitable for use in 
the selection of students. —L.F.S. 


Dvorine, Israel. Devorine Pseudo-Isochromatic Plates. 
(2nd Ed.) Book of 23 plates, wi.h directions 
($12.00). Baltimore 17, Md. (2328 Eutaw Place) : 
Author, 1953. 


The revised Dvorine test consists of the more 
discriminative plates from the longer series pub- 
lished in 1944. Although no adequate data are giv- 
en with the test, a subjective appraisal suggests that 
the series compares favorably with other pseudo- 
isochromatic plates now in use. Pathway-tracing 
plates, a feature of the old Ishihara, are again made 
available for testing young children and illiterates. 
A color-naming test, with saturated colors and tints, 
helps to identify the color ignorant. Several features 
are ingeniously designed to thwart 
—L. F. §. 


malingerers. 


Gordon, Leonard V. Gordon Personal Profile. High 
school, college, adult. 1 form. Untimed, (7-15) 
min. Question booklet ($2.45 per 35), with man- 
ual, pp. 16, and key. Yonkers, N. Y.: World Book 
Co., 1953. 


The Gordon Personal Profile makes available for 
school and industrial use the forced-choice technique 
which has shown some value in the armed forces. 
The questionnaire consists of 18 sets of four de- 
scriptive phrases, two of equal and high preference 
values and two of equal and low values, which are 
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